2024-09-10T11:27:48.480 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T11:27:48.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:27:48.593 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097 branch: wip-athakkar-testing-2024-09-04-1837 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: null first_in_suite: false job_id: '7899097' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-athakkar-testing-2024-09-04-1837 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-04-1837 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 owner: scheduled_khiremat@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9123 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 sleep_before_teardown: 0 subset: 3/4 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-04-1837 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHI6ttIku/9HuTW7anc7yJ5UAyUZO1ZBZVtYzkxKLkHWDVKjR8KjLnCZCU/QVKpkVF2VuozrhN07cRYtveZ3HY= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL0hHeMDZSksbICWpsVN6i5turGFMDjsPbjDvvFGXZDzt0LoSR6KNPXE3cV9rr6UI4zU+KyzaPJFsmKgLjFGA6g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes - tasks.cephfs.test_subvolume teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_07:26:29 tube: smithi user: khiremat verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T11:27:48.593 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa; will attempt to use it 2024-09-10T11:27:48.594 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks 2024-09-10T11:27:48.594 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T11:27:48.595 INFO:teuthology.task.internal:Checking packages... 2024-09-10T11:27:48.624 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73' 2024-09-10T11:27:48.624 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T11:27:48.624 INFO:teuthology.packaging:ref: None 2024-09-10T11:27:48.624 INFO:teuthology.packaging:tag: None 2024-09-10T11:27:48.624 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-04-1837 2024-09-10T11:27:48.624 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:27:48.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-athakkar-testing-2024-09-04-1837 2024-09-10T11:27:48.766 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4704.g8b38c33c 2024-09-10T11:27:48.768 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T11:27:48.774 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T11:27:48.774 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T11:27:48.779 INFO:teuthology.task.internal:Saving configuration 2024-09-10T11:27:48.797 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T11:27:48.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T11:27:48.828 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:22:35.868640', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHI6ttIku/9HuTW7anc7yJ5UAyUZO1ZBZVtYzkxKLkHWDVKjR8KjLnCZCU/QVKpkVF2VuozrhN07cRYtveZ3HY='} 2024-09-10T11:27:48.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 11:22:35.867338', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL0hHeMDZSksbICWpsVN6i5turGFMDjsPbjDvvFGXZDzt0LoSR6KNPXE3cV9rr6UI4zU+KyzaPJFsmKgLjFGA6g='} 2024-09-10T11:27:48.851 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T11:27:48.857 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T11:27:48.857 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T11:27:48.857 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T11:27:48.918 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb83b95fac0>, signals=[15]) 2024-09-10T11:27:48.918 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T11:27:48.922 INFO:teuthology.task.internal:Opening connections... 2024-09-10T11:27:48.922 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:27:48.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:27:49.000 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:27:49.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:27:49.080 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T11:27:49.086 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-09-10T11:27:49.105 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-09-10T11:27:49.106 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-09-10T11:27:49.163 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-09-10T11:27:49.163 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-09-10T11:27:49.163 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-09-10T11:27:49.163 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T11:27:49.164 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T11:27:49.165 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-09-10T11:27:49.189 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-10T11:27:49.207 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-10T11:27:49.208 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-10T11:27:49.265 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T11:27:49.266 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-10T11:27:49.266 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T11:27:49.266 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T11:27:49.266 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T11:27:49.266 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-10T11:27:49.289 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T11:27:49.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T11:27:49.304 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T11:27:49.305 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:27:49.307 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-10T11:27:49.324 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T11:27:49.331 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T11:27:49.331 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:27:49.366 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-10T11:27:49.460 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T11:27:49.518 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T11:27:49.534 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T11:27:49.534 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-10T11:27:49.534 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-10T11:27:49.535 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:27:49.535 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T11:27:49.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:27:49.553 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-09-10T11:27:49.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:27:49.554 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-10T11:27:49.611 INFO:teuthology.orchestra.run.smithi057.stdout:5.14.0-503.el9.x86_64 2024-09-10T11:27:49.611 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.14.0-503.el9.x86_64 2024-09-10T11:27:49.611 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y kernel 2024-09-10T11:27:49.612 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-503.el9.x86_64 2024-09-10T11:27:49.612 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-503.el9.x86_64 2024-09-10T11:27:49.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-09-10T11:27:53.032 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-10T11:27:54.444 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-10T11:27:56.082 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-10T11:27:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-10T11:28:01.550 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-10T11:28:02.854 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-10T11:28:02.992 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 19 kB 00:00 2024-09-10T11:28:03.879 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T11:28:04.388 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-10T11:28:05.351 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-10T11:28:09.560 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T11:28:10.756 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-10T11:28:11.625 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T11:28:11.626 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T11:28:11.735 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-09-10T11:28:11.746 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-09-10T11:28:11.746 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-09-10T11:28:11.746 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-09-10T11:28:11.746 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-09-10T11:28:11.746 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout:Install 4 Packages 2024-09-10T11:28:11.747 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:28:11.748 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 79 M 2024-09-10T11:28:11.748 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 126 M 2024-09-10T11:28:11.748 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-09-10T11:28:11.970 INFO:teuthology.orchestra.run.smithi057.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 190 kB/s | 23 kB 00:00 2024-09-10T11:28:12.787 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T11:28:12.788 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T11:28:12.892 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-10T11:28:12.904 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-10T11:28:12.904 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout:Install 4 Packages 2024-09-10T11:28:12.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:28:12.906 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 79 M 2024-09-10T11:28:12.906 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 126 M 2024-09-10T11:28:12.906 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-10T11:28:13.099 INFO:teuthology.orchestra.run.smithi154.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 240 kB/s | 23 kB 00:00 2024-09-10T11:28:13.466 INFO:teuthology.orchestra.run.smithi154.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-10T11:28:13.569 INFO:teuthology.orchestra.run.smithi057.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.1 MB/s | 16 MB 00:01 2024-09-10T11:28:13.874 INFO:teuthology.orchestra.run.smithi154.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 40 MB/s | 35 MB 00:00 2024-09-10T11:28:14.233 INFO:teuthology.orchestra.run.smithi154.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-10T11:28:14.233 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:28:14.233 INFO:teuthology.orchestra.run.smithi154.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-10T11:28:14.303 INFO:teuthology.orchestra.run.smithi057.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-10T11:28:14.828 INFO:teuthology.orchestra.run.smithi057.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-10T11:28:14.829 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:28:14.829 INFO:teuthology.orchestra.run.smithi057.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-10T11:28:14.919 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-10T11:28:15.262 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-10T11:28:15.262 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-10T11:28:15.532 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-09-10T11:28:15.904 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-09-10T11:28:15.905 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-09-10T11:28:16.205 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-10T11:28:16.206 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-10T11:28:16.914 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-09-10T11:28:16.915 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-09-10T11:28:18.669 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-10T11:28:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T11:28:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:28:19.499 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-09-10T11:28:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T11:28:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:28:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:28:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:28:23.031 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:28:23.167 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:28:27.207 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:28:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:28:28.370 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:28:28.418 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:28:32.170 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:28:33.574 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:10.608 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T11:29:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:29:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:29:11.872 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:11.872 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:29:11.872 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-10T11:29:11.872 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T11:29:11.872 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T11:29:11.872 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T11:29:11.873 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T11:29:11.873 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:29:11.873 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-10T11:29:12.208 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T11:29:12.301 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T11:29:12.301 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T11:29:12.301 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T11:29:12.302 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T11:29:12.302 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T11:29:12.302 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-10T11:29:12.302 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T11:29:12.302 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T11:29:12.360 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T11:29:12.361 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T11:29:12.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2024-09-10T11:29:12.393 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2024-09-10T11:29:12.393 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2024-09-10T11:29:12.393 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.06 2024-09-10T11:29:12.393 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 82.el9 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Group : Unspecified 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 8274670 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : builder@centos.org 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : CentOS 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2024-09-10T11:29:12.394 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:29:12.395 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T11:29:12.396 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T11:29:12.396 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 5.14.0-505.el9.x86_64 2024-09-10T11:29:12.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T11:29:12.906 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:12.947 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:13.057 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-10T11:29:13.306 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:13.306 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T11:29:13.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T11:29:13.307 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T11:29:14.121 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T11:29:14.121 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:29:14.121 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-09-10T11:29:14.121 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.121 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.121 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.122 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.122 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:29:14.122 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-09-10T11:29:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T11:29:14.441 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-10T11:29:14.443 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-10T11:29:14.459 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.TjjxYi3eNh 2024-09-10T11:29:14.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TjjxYi3eNh 2024-09-10T11:29:14.476 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T11:29:14.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.TjjxYi3eNh 2024-09-10T11:29:14.549 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.549 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T11:29:14.549 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T11:29:14.550 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T11:29:14.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T11:29:14.550 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T11:29:14.550 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T11:29:14.550 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T11:29:14.609 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.609 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T11:29:14.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.06 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 82.el9 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Group : Unspecified 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 8274670 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T11:29:14.641 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : builder@centos.org 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : CentOS 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2024-09-10T11:29:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:29:14.643 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T11:29:14.643 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T11:29:14.643 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 5.14.0-505.el9.x86_64 2024-09-10T11:29:14.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T11:29:14.668 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.TjjxYi3eNh is 6KB 2024-09-10T11:29:14.717 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.TjjxYi3eNh 2024-09-10T11:29:14.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T11:29:14.795 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T11:29:14.795 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T11:29:14.795 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T11:29:14.795 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T11:29:14.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T11:29:14.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-10T11:29:15.251 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-09-10T11:29:16.513 INFO:teuthology.orchestra.run.smithi057.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T11:29:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-09-10T11:29:16.540 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-09-10T11:29:16.555 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.JmP9lIA36y 2024-09-10T11:29:16.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JmP9lIA36y 2024-09-10T11:29:16.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.JmP9lIA36y 2024-09-10T11:29:16.783 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.JmP9lIA36y is 6KB 2024-09-10T11:29:16.831 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.JmP9lIA36y 2024-09-10T11:29:16.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T11:29:16.908 INFO:teuthology.orchestra.run.smithi057.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T11:29:16.908 INFO:teuthology.orchestra.run.smithi057.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T11:29:16.908 INFO:teuthology.orchestra.run.smithi057.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T11:29:16.908 INFO:teuthology.orchestra.run.smithi057.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T11:29:16.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T11:29:17.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-09-10T11:29:44.980 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-10T11:29:44.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:29:44.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:29:47.068 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T11:29:47.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:29:47.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:30:03.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-10T11:30:05.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-09-10T11:30:12.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:30:12.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:30:14.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:30:14.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:30:15.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-10T11:30:17.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-09-10T11:30:27.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:30:27.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:30:29.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:30:29.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:30:45.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-10T11:31:00.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:31:00.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:31:01.728 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-10T11:31:02.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:31:02.127 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-10T11:31:02.128 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-10T11:31:02.143 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-505.el9.x86_64 2024-09-10T11:31:02.143 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T11:31:02.143 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T11:31:02.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T11:31:03.144 DEBUG:teuthology.parallel:result is None 2024-09-10T11:31:29.571 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T11:31:44.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:31:44.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:31:44.855 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-09-10T11:31:45.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:31:45.225 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T11:31:45.226 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-09-10T11:31:45.243 INFO:teuthology.orchestra.run.smithi057.stdout:5.14.0-505.el9.x86_64 2024-09-10T11:31:45.243 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T11:31:45.243 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T11:31:45.243 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T11:31:46.244 DEBUG:teuthology.parallel:result is None 2024-09-10T11:31:46.245 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T11:31:46.252 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T11:31:46.252 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:31:46.255 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T11:31:46.276 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T11:31:46.282 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T11:31:46.288 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T11:31:46.288 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:31:46.315 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T11:31:46.579 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T11:31:46.587 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T11:31:46.587 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:31:46.590 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T11:31:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:31:46.713 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:31:46.715 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:31:46.727 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T11:31:46.729 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T11:31:46.737 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T11:31:46.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:31:46.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T11:31:46.769 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T11:31:46.777 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T11:31:46.778 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:31:46.811 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T11:31:46.829 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:31:46.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:31:46.965 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:31:47.049 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:31:47.093 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:31:47.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:31:47.161 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:31:47.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T11:31:47.255 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:31:47.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T11:31:47.381 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:31:47.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T11:31:47.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-09-10T11:31:47.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-10T11:31:47.492 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:31:47.542 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:31:47.929 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T11:31:47.936 INFO:teuthology.task.internal:Starting timer... 2024-09-10T11:31:47.936 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T11:31:47.981 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T11:31:47.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-09-10T11:31:48.057 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-09-10T11:31:48.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-10T11:31:48.130 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-10T11:31:48.132 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T11:31:48.132 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-09-10T11:31:48.167 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-09-10T11:31:48.168 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-10T11:31:48.190 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-10T11:31:48.190 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-09-10T11:31:48.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T11:31:48.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:31:48.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T11:31:48.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:31:48.263 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T11:31:48.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-09-10T11:31:48.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-10T11:31:48.345 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T11:31:48.355 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T11:31:48.366 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T11:31:48.367 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T11:35:34.131 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-10T11:35:34.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:35:34.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:34.213 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-09-10T11:35:34.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-09-10T11:35:34.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:35:34.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T11:35:34.366 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-10T11:35:34.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T11:35:34.445 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T11:35:34.455 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T11:35:34.455 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:35:34.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:35:34.458 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T11:35:34.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:35:34.486 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T11:35:34.502 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T11:35:34.514 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T11:35:34.528 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-09-10T11:35:34.528 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T11:35:34.540 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-09-10T11:35:34.553 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-10T11:35:34.554 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T11:35:34.564 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-10T11:35:34.569 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T11:35:34.579 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T11:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T11:35:34.630 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:35:34.633 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:35:34.633 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-09-10T11:35:34.634 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.634 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.634 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.634 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:35:34.660 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:35:34.660 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T11:35:34.660 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.661 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.661 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.661 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:35:34.661 INFO:teuthology.run_tasks:Running task install... 2024-09-10T11:35:34.669 DEBUG:teuthology.task.install:project ceph 2024-09-10T11:35:34.669 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}} 2024-09-10T11:35:34.669 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'} 2024-09-10T11:35:34.669 INFO:teuthology.task.install:Using flavor: default 2024-09-10T11:35:34.695 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T11:35:34.696 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T11:35:34.696 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'tag': None, 'wait_for_package': False} 2024-09-10T11:35:34.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:35:34.699 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'tag': None, 'wait_for_package': False} 2024-09-10T11:35:34.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:35:34.844 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/ 2024-09-10T11:35:34.844 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4704.g8b38c33c 2024-09-10T11:35:34.847 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/ 2024-09-10T11:35:34.848 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4704.g8b38c33c 2024-09-10T11:35:34.956 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T11:35:34.956 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:35:34.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T11:35:34.964 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T11:35:34.964 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:35:34.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T11:35:34.984 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T11:35:34.984 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T11:35:34.991 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T11:35:34.991 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T11:35:35.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T11:35:35.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T11:35:35.128 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T11:35:35.132 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T11:35:35.194 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-09-10T11:35:35.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-09-10T11:35:35.196 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-10T11:35:35.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-10T11:35:35.428 INFO:teuthology.orchestra.run.smithi057.stdout:45 files removed 2024-09-10T11:35:35.447 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-10T11:35:35.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T11:35:35.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T11:35:36.029 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-10T11:35:36.036 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-10T11:35:36.406 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 73 kB/s | 24 kB 00:00 2024-09-10T11:35:36.412 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 72 kB/s | 24 kB 00:00 2024-09-10T11:35:36.688 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T11:35:36.690 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T11:35:38.421 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-10T11:35:38.639 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-10T11:35:40.591 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T11:35:43.905 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-10T11:35:46.233 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T11:35:47.717 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 108 kB/s | 19 kB 00:00 2024-09-10T11:35:48.804 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T11:35:52.072 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.5 MB 00:04 2024-09-10T11:35:53.964 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-10T11:35:54.535 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T11:35:54.785 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-10T11:35:56.990 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:35:56.991 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:35:57.005 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T11:35:57.006 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T11:35:57.007 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T11:35:57.008 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T11:35:57.010 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T11:35:57.013 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T11:35:57.014 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T11:35:57.083 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 6.6 k 2024-09-10T11:35:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 5.5 M 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 900 k 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 145 k 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 1.5 M 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 154 k 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 14 M 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 7.4 M 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 49 k 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 11 M 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 50 M 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 285 k 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 783 k 2024-09-10T11:35:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 226 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-shell x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 27 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 18 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 32 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 756 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 127 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T11:35:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 161 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 320 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 305 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 99 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 86 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 3.2 M 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 170 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T11:35:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 3.5 M 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 3.2 M 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 22 M 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 34 k 2024-09-10T11:35:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 2.4 M 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 291 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 4.8 M 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 17 M 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 16 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 25 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T11:35:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 161 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 508 k 2024-09-10T11:35:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 5.5 M 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T11:35:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 45 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 145 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T11:35:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T11:35:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T11:35:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T11:35:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T11:35:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T11:35:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T11:35:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T11:35:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T11:35:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Install 148 Packages 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 8 Packages 2024-09-10T11:35:57.117 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:35:57.118 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 240 M 2024-09-10T11:35:57.118 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-09-10T11:35:57.678 INFO:teuthology.orchestra.run.smithi057.stdout:(1/156): ceph-19.3.0-4704.g8b38c33c.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-09-10T11:35:57.903 INFO:teuthology.orchestra.run.smithi057.stdout:(2/156): ceph-base-19.3.0-4704.g8b38c33c.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-10T11:35:57.962 INFO:teuthology.orchestra.run.smithi057.stdout:(3/156): ceph-fuse-19.3.0-4704.g8b38c33c.el9.x8 3.1 MB/s | 900 kB 00:00 2024-09-10T11:35:58.879 INFO:teuthology.orchestra.run.smithi057.stdout:(4/156): ceph-common-19.3.0-4704.g8b38c33c.el9. 15 MB/s | 22 MB 00:01 2024-09-10T11:35:58.904 INFO:teuthology.orchestra.run.smithi057.stdout:(5/156): ceph-immutable-object-cache-19.3.0-470 145 kB/s | 145 kB 00:01 2024-09-10T11:35:58.963 INFO:teuthology.orchestra.run.smithi057.stdout:(6/156): ceph-mds-19.3.0-4704.g8b38c33c.el9.x86 2.4 MB/s | 2.4 MB 00:01 2024-09-10T11:35:59.096 INFO:teuthology.orchestra.run.smithi057.stdout:(7/156): ceph-mgr-19.3.0-4704.g8b38c33c.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-10T11:35:59.863 INFO:teuthology.orchestra.run.smithi057.stdout:(8/156): ceph-osd-19.3.0-4704.g8b38c33c.el9.x86 19 MB/s | 17 MB 00:00 2024-09-10T11:35:59.947 INFO:teuthology.orchestra.run.smithi057.stdout:(9/156): ceph-mon-19.3.0-4704.g8b38c33c.el9.x86 4.6 MB/s | 4.8 MB 00:01 2024-09-10T11:36:00.197 INFO:teuthology.orchestra.run.smithi057.stdout:(10/156): ceph-radosgw-19.3.0-4704.g8b38c33c.el 9.9 MB/s | 11 MB 00:01 2024-09-10T11:36:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-10T11:36:00.222 INFO:teuthology.orchestra.run.smithi057.stdout:(11/156): ceph-selinux-19.3.0-4704.g8b38c33c.el 70 kB/s | 25 kB 00:00 2024-09-10T11:36:02.197 INFO:teuthology.orchestra.run.smithi057.stdout:(12/156): ceph-test-19.3.0-4704.g8b38c33c.el9.x 22 MB/s | 50 MB 00:02 2024-09-10T11:36:02.222 INFO:teuthology.orchestra.run.smithi057.stdout:(13/156): cephfs-shell-19.3.0-4704.g8b38c33c.el 13 kB/s | 27 kB 00:01 2024-09-10T11:36:02.247 INFO:teuthology.orchestra.run.smithi057.stdout:(14/156): cephfs-mirror-19.3.0-4704.g8b38c33c.e 110 kB/s | 226 kB 00:02 2024-09-10T11:36:02.273 INFO:teuthology.orchestra.run.smithi057.stdout:(15/156): libcephfs-devel-19.3.0-4704.g8b38c33c 422 kB/s | 32 kB 00:00 2024-09-10T11:36:02.415 INFO:teuthology.orchestra.run.smithi057.stdout:(16/156): librados-devel-19.3.0-4704.g8b38c33c. 894 kB/s | 127 kB 00:00 2024-09-10T11:36:02.440 INFO:teuthology.orchestra.run.smithi057.stdout:(17/156): libcephsqlite-19.3.0-4704.g8b38c33c.e 840 kB/s | 161 kB 00:00 2024-09-10T11:36:02.511 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:36:02.512 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T11:36:02.515 INFO:teuthology.orchestra.run.smithi057.stdout:(18/156): libradosstriper1-19.3.0-4704.g8b38c33 5.0 MB/s | 508 kB 00:00 2024-09-10T11:36:02.525 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T11:36:02.526 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T11:36:02.527 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T11:36:02.528 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T11:36:02.530 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T11:36:02.532 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T11:36:02.533 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T11:36:02.549 INFO:teuthology.orchestra.run.smithi057.stdout:(19/156): libcephfs2-19.3.0-4704.g8b38c33c.el9. 2.3 MB/s | 756 kB 00:00 2024-09-10T11:36:02.596 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 6.6 k 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 5.5 M 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 900 k 2024-09-10T11:36:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 145 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 1.5 M 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 154 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 14 M 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 7.4 M 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 49 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 11 M 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 50 M 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 285 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 783 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 226 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 27 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 18 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T11:36:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 32 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 756 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 127 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 161 k 2024-09-10T11:36:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 320 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 305 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 99 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 86 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 3.2 M 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 170 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 3.5 M 2024-09-10T11:36:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 3.2 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 22 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 34 k 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 2.4 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 291 k 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 4.8 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 17 M 2024-09-10T11:36:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4704.g8b38c33c.el9 ceph-noarch 16 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 25 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 161 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T11:36:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 508 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 5.5 M 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T11:36:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 45 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.3.0-4704.g8b38c33c.el9 ceph 145 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T11:36:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T11:36:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T11:36:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T11:36:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T11:36:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T11:36:02.630 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:02.631 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-10T11:36:02.631 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T11:36:02.631 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-09-10T11:36:02.631 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-10T11:36:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:02.631 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 240 M 2024-09-10T11:36:02.632 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-10T11:36:02.965 INFO:teuthology.orchestra.run.smithi057.stdout:(20/156): librgw2-19.3.0-4704.g8b38c33c.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-10T11:36:02.966 INFO:teuthology.orchestra.run.smithi154.stdout:(1/156): ceph-19.3.0-4704.g8b38c33c.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-10T11:36:02.991 INFO:teuthology.orchestra.run.smithi057.stdout:(21/156): python3-ceph-argparse-19.3.0-4704.g8b 95 kB/s | 45 kB 00:00 2024-09-10T11:36:03.016 INFO:teuthology.orchestra.run.smithi057.stdout:(22/156): python3-ceph-common-19.3.0-4704.g8b38 310 kB/s | 145 kB 00:00 2024-09-10T11:36:03.041 INFO:teuthology.orchestra.run.smithi057.stdout:(23/156): python3-cephfs-19.3.0-4704.g8b38c33c. 2.1 MB/s | 161 kB 00:00 2024-09-10T11:36:03.125 INFO:teuthology.orchestra.run.smithi057.stdout:(24/156): python3-rados-19.3.0-4704.g8b38c33c.e 2.3 MB/s | 320 kB 00:00 2024-09-10T11:36:03.367 INFO:teuthology.orchestra.run.smithi057.stdout:(25/156): python3-rbd-19.3.0-4704.g8b38c33c.el9 871 kB/s | 305 kB 00:00 2024-09-10T11:36:03.392 INFO:teuthology.orchestra.run.smithi057.stdout:(26/156): python3-rgw-19.3.0-4704.g8b38c33c.el9 284 kB/s | 99 kB 00:00 2024-09-10T11:36:03.400 INFO:teuthology.orchestra.run.smithi154.stdout:(2/156): ceph-fuse-19.3.0-4704.g8b38c33c.el9.x8 2.0 MB/s | 900 kB 00:00 2024-09-10T11:36:03.417 INFO:teuthology.orchestra.run.smithi057.stdout:(27/156): rbd-fuse-19.3.0-4704.g8b38c33c.el9.x8 293 kB/s | 86 kB 00:00 2024-09-10T11:36:03.450 INFO:teuthology.orchestra.run.smithi154.stdout:(3/156): ceph-immutable-object-cache-19.3.0-470 2.8 MB/s | 145 kB 00:00 2024-09-10T11:36:03.468 INFO:teuthology.orchestra.run.smithi057.stdout:(28/156): rbd-nbd-19.3.0-4704.g8b38c33c.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-10T11:36:03.493 INFO:teuthology.orchestra.run.smithi057.stdout:(29/156): ceph-grafana-dashboards-19.3.0-4704.g 455 kB/s | 34 kB 00:00 2024-09-10T11:36:03.535 INFO:teuthology.orchestra.run.smithi057.stdout:(30/156): ceph-mgr-cephadm-19.3.0-4704.g8b38c33 2.3 MB/s | 154 kB 00:00 2024-09-10T11:36:03.694 INFO:teuthology.orchestra.run.smithi057.stdout:(31/156): rbd-mirror-19.3.0-4704.g8b38c33c.el9. 9.7 MB/s | 3.2 MB 00:00 2024-09-10T11:36:03.902 INFO:teuthology.orchestra.run.smithi057.stdout:(32/156): ceph-mgr-modules-core-19.3.0-4704.g8b 1.4 MB/s | 291 kB 00:00 2024-09-10T11:36:03.925 INFO:teuthology.orchestra.run.smithi154.stdout:(4/156): ceph-mds-19.3.0-4704.g8b38c33c.el9.x86 5.0 MB/s | 2.4 MB 00:00 2024-09-10T11:36:04.252 INFO:teuthology.orchestra.run.smithi057.stdout:(33/156): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-10T11:36:04.311 INFO:teuthology.orchestra.run.smithi057.stdout:(34/156): ceph-prometheus-alerts-19.3.0-4704.g8 284 kB/s | 16 kB 00:00 2024-09-10T11:36:04.351 INFO:teuthology.orchestra.run.smithi154.stdout:(5/156): ceph-mgr-19.3.0-4704.g8b38c33c.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-09-10T11:36:04.361 INFO:teuthology.orchestra.run.smithi057.stdout:(35/156): ceph-volume-19.3.0-4704.g8b38c33c.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T11:36:04.395 INFO:teuthology.orchestra.run.smithi057.stdout:(36/156): ceph-mgr-rook-19.3.0-4704.g8b38c33c.e 100 kB/s | 49 kB 00:00 2024-09-10T11:36:04.478 INFO:teuthology.orchestra.run.smithi057.stdout:(37/156): cephfs-top-19.3.0-4704.g8b38c33c.el9. 219 kB/s | 18 kB 00:00 2024-09-10T11:36:04.512 INFO:teuthology.orchestra.run.smithi057.stdout:(38/156): cephadm-19.3.0-4704.g8b38c33c.el9.noa 5.1 MB/s | 783 kB 00:00 2024-09-10T11:36:04.612 INFO:teuthology.orchestra.run.smithi057.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-10T11:36:04.704 INFO:teuthology.orchestra.run.smithi057.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-10T11:36:04.779 INFO:teuthology.orchestra.run.smithi057.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T11:36:04.813 INFO:teuthology.orchestra.run.smithi057.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-10T11:36:04.871 INFO:teuthology.orchestra.run.smithi057.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T11:36:04.922 INFO:teuthology.orchestra.run.smithi057.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T11:36:04.964 INFO:teuthology.orchestra.run.smithi057.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-10T11:36:05.023 INFO:teuthology.orchestra.run.smithi057.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-09-10T11:36:05.047 INFO:teuthology.orchestra.run.smithi057.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T11:36:05.206 INFO:teuthology.orchestra.run.smithi057.stdout:(48/156): ceph-mgr-dashboard-19.3.0-4704.g8b38c 8.3 MB/s | 14 MB 00:01 2024-09-10T11:36:05.409 INFO:teuthology.orchestra.run.smithi154.stdout:(6/156): ceph-common-19.3.0-4704.g8b38c33c.el9. 8.4 MB/s | 22 MB 00:02 2024-09-10T11:36:05.484 INFO:teuthology.orchestra.run.smithi154.stdout:(7/156): ceph-mon-19.3.0-4704.g8b38c33c.el9.x86 4.2 MB/s | 4.8 MB 00:01 2024-09-10T11:36:05.576 INFO:teuthology.orchestra.run.smithi154.stdout:(8/156): ceph-base-19.3.0-4704.g8b38c33c.el9.x8 2.0 MB/s | 5.5 MB 00:02 2024-09-10T11:36:05.652 INFO:teuthology.orchestra.run.smithi154.stdout:(9/156): ceph-selinux-19.3.0-4704.g8b38c33c.el9 335 kB/s | 25 kB 00:00 2024-09-10T11:36:05.865 INFO:teuthology.orchestra.run.smithi057.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 162 kB/s | 107 kB 00:00 2024-09-10T11:36:06.007 INFO:teuthology.orchestra.run.smithi057.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 700 kB/s | 689 kB 00:00 2024-09-10T11:36:06.140 INFO:teuthology.orchestra.run.smithi057.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 863 kB/s | 943 kB 00:01 2024-09-10T11:36:06.399 INFO:teuthology.orchestra.run.smithi057.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-10T11:36:06.477 INFO:teuthology.orchestra.run.smithi154.stdout:(10/156): ceph-osd-19.3.0-4704.g8b38c33c.el9.x8 16 MB/s | 17 MB 00:01 2024-09-10T11:36:06.528 INFO:teuthology.orchestra.run.smithi154.stdout:(11/156): cephfs-mirror-19.3.0-4704.g8b38c33c.e 4.4 MB/s | 226 kB 00:00 2024-09-10T11:36:06.569 INFO:teuthology.orchestra.run.smithi154.stdout:(12/156): cephfs-shell-19.3.0-4704.g8b38c33c.el 652 kB/s | 27 kB 00:00 2024-09-10T11:36:06.611 INFO:teuthology.orchestra.run.smithi154.stdout:(13/156): libcephfs-devel-19.3.0-4704.g8b38c33c 759 kB/s | 32 kB 00:00 2024-09-10T11:36:06.686 INFO:teuthology.orchestra.run.smithi154.stdout:(14/156): libcephfs2-19.3.0-4704.g8b38c33c.el9. 9.9 MB/s | 756 kB 00:00 2024-09-10T11:36:06.716 INFO:teuthology.orchestra.run.smithi057.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 57 kB/s | 33 kB 00:00 2024-09-10T11:36:06.737 INFO:teuthology.orchestra.run.smithi154.stdout:(15/156): libcephsqlite-19.3.0-4704.g8b38c33c.e 3.1 MB/s | 161 kB 00:00 2024-09-10T11:36:06.787 INFO:teuthology.orchestra.run.smithi154.stdout:(16/156): librados-devel-19.3.0-4704.g8b38c33c. 2.5 MB/s | 127 kB 00:00 2024-09-10T11:36:06.824 INFO:teuthology.orchestra.run.smithi057.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 384 kB/s | 313 kB 00:00 2024-09-10T11:36:06.845 INFO:teuthology.orchestra.run.smithi154.stdout:(17/156): libradosstriper1-19.3.0-4704.g8b38c33 8.5 MB/s | 508 kB 00:00 2024-09-10T11:36:07.087 INFO:teuthology.orchestra.run.smithi154.stdout:(18/156): librgw2-19.3.0-4704.g8b38c33c.el9.x86 23 MB/s | 5.5 MB 00:00 2024-09-10T11:36:07.129 INFO:teuthology.orchestra.run.smithi154.stdout:(19/156): python3-ceph-argparse-19.3.0-4704.g8b 1.1 MB/s | 45 kB 00:00 2024-09-10T11:36:07.179 INFO:teuthology.orchestra.run.smithi154.stdout:(20/156): python3-ceph-common-19.3.0-4704.g8b38 2.8 MB/s | 145 kB 00:00 2024-09-10T11:36:07.199 INFO:teuthology.orchestra.run.smithi057.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-10T11:36:07.255 INFO:teuthology.orchestra.run.smithi154.stdout:(21/156): python3-cephfs-19.3.0-4704.g8b38c33c. 2.1 MB/s | 161 kB 00:00 2024-09-10T11:36:07.316 INFO:teuthology.orchestra.run.smithi057.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-10T11:36:07.338 INFO:teuthology.orchestra.run.smithi154.stdout:(22/156): python3-rados-19.3.0-4704.g8b38c33c.e 3.8 MB/s | 320 kB 00:00 2024-09-10T11:36:07.455 INFO:teuthology.orchestra.run.smithi154.stdout:(23/156): ceph-radosgw-19.3.0-4704.g8b38c33c.el 5.5 MB/s | 11 MB 00:01 2024-09-10T11:36:07.480 INFO:teuthology.orchestra.run.smithi154.stdout:(24/156): python3-rbd-19.3.0-4704.g8b38c33c.el9 2.1 MB/s | 305 kB 00:00 2024-09-10T11:36:07.483 INFO:teuthology.orchestra.run.smithi057.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-10T11:36:07.506 INFO:teuthology.orchestra.run.smithi154.stdout:(25/156): python3-rgw-19.3.0-4704.g8b38c33c.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T11:36:07.556 INFO:teuthology.orchestra.run.smithi154.stdout:(26/156): rbd-fuse-19.3.0-4704.g8b38c33c.el9.x8 1.1 MB/s | 86 kB 00:00 2024-09-10T11:36:07.631 INFO:teuthology.orchestra.run.smithi154.stdout:(27/156): rbd-nbd-19.3.0-4704.g8b38c33c.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-10T11:36:07.715 INFO:teuthology.orchestra.run.smithi154.stdout:(28/156): ceph-grafana-dashboards-19.3.0-4704.g 411 kB/s | 34 kB 00:00 2024-09-10T11:36:07.807 INFO:teuthology.orchestra.run.smithi154.stdout:(29/156): ceph-mgr-cephadm-19.3.0-4704.g8b38c33 1.6 MB/s | 154 kB 00:00 2024-09-10T11:36:07.917 INFO:teuthology.orchestra.run.smithi057.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2024-09-10T11:36:07.942 INFO:teuthology.orchestra.run.smithi057.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-09-10T11:36:08.299 INFO:teuthology.orchestra.run.smithi154.stdout:(30/156): rbd-mirror-19.3.0-4704.g8b38c33c.el9. 4.0 MB/s | 3.2 MB 00:00 2024-09-10T11:36:08.368 INFO:teuthology.orchestra.run.smithi057.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 750 kB/s | 662 kB 00:00 2024-09-10T11:36:08.518 INFO:teuthology.orchestra.run.smithi057.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-10T11:36:08.616 INFO:teuthology.orchestra.run.smithi154.stdout:(31/156): ceph-mgr-dashboard-19.3.0-4704.g8b38c 18 MB/s | 14 MB 00:00 2024-09-10T11:36:08.666 INFO:teuthology.orchestra.run.smithi154.stdout:(32/156): ceph-mgr-modules-core-19.3.0-4704.g8b 5.7 MB/s | 291 kB 00:00 2024-09-10T11:36:08.716 INFO:teuthology.orchestra.run.smithi154.stdout:(33/156): ceph-mgr-rook-19.3.0-4704.g8b38c33c.e 990 kB/s | 49 kB 00:00 2024-09-10T11:36:08.766 INFO:teuthology.orchestra.run.smithi154.stdout:(34/156): ceph-prometheus-alerts-19.3.0-4704.g8 330 kB/s | 16 kB 00:00 2024-09-10T11:36:08.784 INFO:teuthology.orchestra.run.smithi057.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 671 kB/s | 581 kB 00:00 2024-09-10T11:36:08.825 INFO:teuthology.orchestra.run.smithi154.stdout:(35/156): ceph-volume-19.3.0-4704.g8b38c33c.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T11:36:08.892 INFO:teuthology.orchestra.run.smithi154.stdout:(36/156): cephadm-19.3.0-4704.g8b38c33c.el9.noa 12 MB/s | 783 kB 00:00 2024-09-10T11:36:08.942 INFO:teuthology.orchestra.run.smithi154.stdout:(37/156): cephfs-top-19.3.0-4704.g8b38c33c.el9. 366 kB/s | 18 kB 00:00 2024-09-10T11:36:08.951 INFO:teuthology.orchestra.run.smithi057.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-10T11:36:09.076 INFO:teuthology.orchestra.run.smithi154.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-10T11:36:09.201 INFO:teuthology.orchestra.run.smithi154.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 6.3 MB/s | 801 kB 00:00 2024-09-10T11:36:09.293 INFO:teuthology.orchestra.run.smithi154.stdout:(40/156): ceph-mgr-diskprediction-local-19.3.0- 7.5 MB/s | 7.4 MB 00:00 2024-09-10T11:36:09.310 INFO:teuthology.orchestra.run.smithi057.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-10T11:36:09.318 INFO:teuthology.orchestra.run.smithi154.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-10T11:36:09.402 INFO:teuthology.orchestra.run.smithi154.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-10T11:36:09.444 INFO:teuthology.orchestra.run.smithi154.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T11:36:09.486 INFO:teuthology.orchestra.run.smithi154.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-10T11:36:09.503 INFO:teuthology.orchestra.run.smithi154.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T11:36:09.518 INFO:teuthology.orchestra.run.smithi057.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-10T11:36:09.545 INFO:teuthology.orchestra.run.smithi154.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T11:36:09.552 INFO:teuthology.orchestra.run.smithi057.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-10T11:36:09.570 INFO:teuthology.orchestra.run.smithi154.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-10T11:36:09.671 INFO:teuthology.orchestra.run.smithi154.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-09-10T11:36:09.712 INFO:teuthology.orchestra.run.smithi154.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-09-10T11:36:09.763 INFO:teuthology.orchestra.run.smithi154.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-10T11:36:09.797 INFO:teuthology.orchestra.run.smithi154.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 852 kB/s | 107 kB 00:00 2024-09-10T11:36:09.863 INFO:teuthology.orchestra.run.smithi154.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-10T11:36:10.147 INFO:teuthology.orchestra.run.smithi154.stdout:(53/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-10T11:36:10.206 INFO:teuthology.orchestra.run.smithi154.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-09-10T11:36:10.264 INFO:teuthology.orchestra.run.smithi154.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-10T11:36:10.289 INFO:teuthology.orchestra.run.smithi154.stdout:(56/156): flex-2.6.4-9.el9.x86_64.rpm 596 kB/s | 313 kB 00:00 2024-09-10T11:36:10.365 INFO:teuthology.orchestra.run.smithi154.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 605 kB/s | 45 kB 00:00 2024-09-10T11:36:10.390 INFO:teuthology.orchestra.run.smithi154.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-10T11:36:10.444 INFO:teuthology.orchestra.run.smithi057.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-10T11:36:10.499 INFO:teuthology.orchestra.run.smithi154.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-10T11:36:10.511 INFO:teuthology.orchestra.run.smithi057.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-09-10T11:36:10.574 INFO:teuthology.orchestra.run.smithi154.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 327 kB/s | 24 kB 00:00 2024-09-10T11:36:10.657 INFO:teuthology.orchestra.run.smithi154.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-09-10T11:36:10.669 INFO:teuthology.orchestra.run.smithi057.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-10T11:36:10.699 INFO:teuthology.orchestra.run.smithi154.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 379 kB/s | 47 kB 00:00 2024-09-10T11:36:10.758 INFO:teuthology.orchestra.run.smithi154.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-10T11:36:10.892 INFO:teuthology.orchestra.run.smithi154.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 982 kB/s | 188 kB 00:00 2024-09-10T11:36:10.917 INFO:teuthology.orchestra.run.smithi154.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 243 kB/s | 38 kB 00:00 2024-09-10T11:36:11.237 INFO:teuthology.orchestra.run.smithi057.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 189 kB/s | 137 kB 00:00 2024-09-10T11:36:11.417 INFO:teuthology.orchestra.run.smithi154.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-10T11:36:11.428 INFO:teuthology.orchestra.run.smithi057.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 925 kB/s | 910 kB 00:00 2024-09-10T11:36:11.684 INFO:teuthology.orchestra.run.smithi154.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.0 MB/s | 1.6 MB 00:00 2024-09-10T11:36:11.801 INFO:teuthology.orchestra.run.smithi154.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-10T11:36:11.820 INFO:teuthology.orchestra.run.smithi057.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-10T11:36:11.902 INFO:teuthology.orchestra.run.smithi154.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-10T11:36:12.077 INFO:teuthology.orchestra.run.smithi154.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.2 MB/s | 4.9 MB 00:01 2024-09-10T11:36:12.104 INFO:teuthology.orchestra.run.smithi057.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 130 kB/s | 87 kB 00:00 2024-09-10T11:36:12.152 INFO:teuthology.orchestra.run.smithi154.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-10T11:36:12.219 INFO:teuthology.orchestra.run.smithi154.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T11:36:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-10T11:36:12.261 INFO:teuthology.orchestra.run.smithi154.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-10T11:36:12.328 INFO:teuthology.orchestra.run.smithi154.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 919 kB/s | 61 kB 00:00 2024-09-10T11:36:12.428 INFO:teuthology.orchestra.run.smithi154.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T11:36:12.503 INFO:teuthology.orchestra.run.smithi154.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-09-10T11:36:12.562 INFO:teuthology.orchestra.run.smithi154.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-10T11:36:12.621 INFO:teuthology.orchestra.run.smithi154.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-10T11:36:12.687 INFO:teuthology.orchestra.run.smithi154.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 959 kB/s | 248 kB 00:00 2024-09-10T11:36:12.746 INFO:teuthology.orchestra.run.smithi154.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-10T11:36:12.762 INFO:teuthology.orchestra.run.smithi057.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 93 kB/s | 61 kB 00:00 2024-09-10T11:36:12.788 INFO:teuthology.orchestra.run.smithi154.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-10T11:36:13.004 INFO:teuthology.orchestra.run.smithi057.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 319 kB/s | 245 kB 00:00 2024-09-10T11:36:13.005 INFO:teuthology.orchestra.run.smithi154.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-09-10T11:36:13.088 INFO:teuthology.orchestra.run.smithi057.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-10T11:36:13.097 INFO:teuthology.orchestra.run.smithi154.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T11:36:13.189 INFO:teuthology.orchestra.run.smithi154.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 842 kB/s | 77 kB 00:00 2024-09-10T11:36:13.272 INFO:teuthology.orchestra.run.smithi154.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 509 kB/s | 42 kB 00:00 2024-09-10T11:36:13.364 INFO:teuthology.orchestra.run.smithi154.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-10T11:36:13.557 INFO:teuthology.orchestra.run.smithi154.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 829 kB/s | 159 kB 00:00 2024-09-10T11:36:13.563 INFO:teuthology.orchestra.run.smithi057.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 310 kB/s | 248 kB 00:00 2024-09-10T11:36:13.580 INFO:teuthology.orchestra.run.smithi057.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-10T11:36:13.597 INFO:teuthology.orchestra.run.smithi057.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-10T11:36:13.690 INFO:teuthology.orchestra.run.smithi154.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-09-10T11:36:13.749 INFO:teuthology.orchestra.run.smithi154.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-10T11:36:13.774 INFO:teuthology.orchestra.run.smithi154.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 612 kB/s | 51 kB 00:00 2024-09-10T11:36:13.832 INFO:teuthology.orchestra.run.smithi154.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-09-10T11:36:13.891 INFO:teuthology.orchestra.run.smithi154.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-09-10T11:36:13.966 INFO:teuthology.orchestra.run.smithi154.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 591 kB/s | 44 kB 00:00 2024-09-10T11:36:14.117 INFO:teuthology.orchestra.run.smithi154.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-10T11:36:14.130 INFO:teuthology.orchestra.run.smithi057.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-10T11:36:14.192 INFO:teuthology.orchestra.run.smithi154.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 479 kB/s | 36 kB 00:00 2024-09-10T11:36:14.272 INFO:teuthology.orchestra.run.smithi057.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 243 kB/s | 172 kB 00:00 2024-09-10T11:36:14.276 INFO:teuthology.orchestra.run.smithi154.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-09-10T11:36:14.368 INFO:teuthology.orchestra.run.smithi154.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-10T11:36:14.435 INFO:teuthology.orchestra.run.smithi154.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 869 kB/s | 58 kB 00:00 2024-09-10T11:36:14.510 INFO:teuthology.orchestra.run.smithi154.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-10T11:36:14.577 INFO:teuthology.orchestra.run.smithi154.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 959 kB/s | 64 kB 00:00 2024-09-10T11:36:14.644 INFO:teuthology.orchestra.run.smithi154.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-09-10T11:36:14.719 INFO:teuthology.orchestra.run.smithi154.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-10T11:36:14.797 INFO:teuthology.orchestra.run.smithi057.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-10T11:36:14.869 INFO:teuthology.orchestra.run.smithi154.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-09-10T11:36:14.906 INFO:teuthology.orchestra.run.smithi057.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 323 kB/s | 250 kB 00:00 2024-09-10T11:36:14.928 INFO:teuthology.orchestra.run.smithi154.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T11:36:14.953 INFO:teuthology.orchestra.run.smithi154.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-10T11:36:14.978 INFO:teuthology.orchestra.run.smithi154.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-10T11:36:15.073 INFO:teuthology.orchestra.run.smithi057.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 278 kB/s | 222 kB 00:00 2024-09-10T11:36:15.104 INFO:teuthology.orchestra.run.smithi154.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-10T11:36:15.129 INFO:teuthology.orchestra.run.smithi154.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T11:36:15.154 INFO:teuthology.orchestra.run.smithi154.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T11:36:15.180 INFO:teuthology.orchestra.run.smithi154.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T11:36:15.205 INFO:teuthology.orchestra.run.smithi154.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-10T11:36:15.238 INFO:teuthology.orchestra.run.smithi154.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-10T11:36:15.280 INFO:teuthology.orchestra.run.smithi154.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T11:36:15.306 INFO:teuthology.orchestra.run.smithi154.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T11:36:15.331 INFO:teuthology.orchestra.run.smithi154.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T11:36:15.473 INFO:teuthology.orchestra.run.smithi057.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 114 kB/s | 77 kB 00:00 2024-09-10T11:36:15.548 INFO:teuthology.orchestra.run.smithi057.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 66 kB/s | 42 kB 00:00 2024-09-10T11:36:15.773 INFO:teuthology.orchestra.run.smithi154.stdout:(116/156): ceph-test-19.3.0-4704.g8b38c33c.el9. 5.0 MB/s | 50 MB 00:10 2024-09-10T11:36:15.798 INFO:teuthology.orchestra.run.smithi154.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 30 kB/s | 14 kB 00:00 2024-09-10T11:36:15.831 INFO:teuthology.orchestra.run.smithi154.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-10T11:36:15.865 INFO:teuthology.orchestra.run.smithi154.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.4 MB/s | 303 kB 00:00 2024-09-10T11:36:15.907 INFO:teuthology.orchestra.run.smithi154.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-10T11:36:15.932 INFO:teuthology.orchestra.run.smithi154.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-10T11:36:15.966 INFO:teuthology.orchestra.run.smithi154.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T11:36:15.991 INFO:teuthology.orchestra.run.smithi154.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-10T11:36:16.017 INFO:teuthology.orchestra.run.smithi154.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-10T11:36:16.050 INFO:teuthology.orchestra.run.smithi154.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 694 kB/s | 23 kB 00:00 2024-09-10T11:36:16.099 INFO:teuthology.orchestra.run.smithi057.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 263 kB/s | 269 kB 00:01 2024-09-10T11:36:16.101 INFO:teuthology.orchestra.run.smithi154.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-10T11:36:16.117 INFO:teuthology.orchestra.run.smithi154.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-10T11:36:16.168 INFO:teuthology.orchestra.run.smithi154.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-10T11:36:16.185 INFO:teuthology.orchestra.run.smithi154.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-10T11:36:16.210 INFO:teuthology.orchestra.run.smithi154.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T11:36:16.252 INFO:teuthology.orchestra.run.smithi154.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-10T11:36:16.277 INFO:teuthology.orchestra.run.smithi154.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-10T11:36:16.299 INFO:teuthology.orchestra.run.smithi057.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 192 kB/s | 159 kB 00:00 2024-09-10T11:36:16.303 INFO:teuthology.orchestra.run.smithi154.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-10T11:36:16.328 INFO:teuthology.orchestra.run.smithi154.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T11:36:16.353 INFO:teuthology.orchestra.run.smithi154.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T11:36:16.379 INFO:teuthology.orchestra.run.smithi154.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T11:36:16.404 INFO:teuthology.orchestra.run.smithi154.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T11:36:16.429 INFO:teuthology.orchestra.run.smithi154.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T11:36:16.454 INFO:teuthology.orchestra.run.smithi154.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-10T11:36:16.480 INFO:teuthology.orchestra.run.smithi154.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-10T11:36:16.505 INFO:teuthology.orchestra.run.smithi154.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T11:36:16.507 INFO:teuthology.orchestra.run.smithi057.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 291 kB/s | 279 kB 00:00 2024-09-10T11:36:16.530 INFO:teuthology.orchestra.run.smithi154.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T11:36:16.555 INFO:teuthology.orchestra.run.smithi154.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T11:36:16.581 INFO:teuthology.orchestra.run.smithi154.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-10T11:36:16.614 INFO:teuthology.orchestra.run.smithi154.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-10T11:36:16.640 INFO:teuthology.orchestra.run.smithi154.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T11:36:16.708 INFO:teuthology.orchestra.run.smithi057.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-10T11:36:16.815 INFO:teuthology.orchestra.run.smithi154.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:03 2024-09-10T11:36:16.857 INFO:teuthology.orchestra.run.smithi154.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-09-10T11:36:16.908 INFO:teuthology.orchestra.run.smithi057.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 88 kB/s | 54 kB 00:00 2024-09-10T11:36:17.124 INFO:teuthology.orchestra.run.smithi154.stdout:(149/156): librados2-19.3.0-4704.g8b38c33c.el9. 7.2 MB/s | 3.5 MB 00:00 2024-09-10T11:36:17.174 INFO:teuthology.orchestra.run.smithi154.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-10T11:36:17.216 INFO:teuthology.orchestra.run.smithi154.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 981 kB/s | 41 kB 00:00 2024-09-10T11:36:17.275 INFO:teuthology.orchestra.run.smithi154.stdout:(152/156): librbd1-19.3.0-4704.g8b38c33c.el9.x8 7.1 MB/s | 3.2 MB 00:00 2024-09-10T11:36:17.275 INFO:teuthology.orchestra.run.smithi057.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-10T11:36:17.300 INFO:teuthology.orchestra.run.smithi154.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-10T11:36:17.383 INFO:teuthology.orchestra.run.smithi154.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-10T11:36:17.484 INFO:teuthology.orchestra.run.smithi057.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-10T11:36:17.534 INFO:teuthology.orchestra.run.smithi154.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-10T11:36:17.776 INFO:teuthology.orchestra.run.smithi154.stdout:(156/156): NetworkManager-libnm-1.49.90-1.el9.x 2.8 MB/s | 1.8 MB 00:00 2024-09-10T11:36:17.781 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:36:17.782 INFO:teuthology.orchestra.run.smithi154.stdout:Total 16 MB/s | 240 MB 00:15 2024-09-10T11:36:18.084 INFO:teuthology.orchestra.run.smithi057.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-10T11:36:18.109 INFO:teuthology.orchestra.run.smithi057.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 57 kB/s | 36 kB 00:00 2024-09-10T11:36:18.134 INFO:teuthology.orchestra.run.smithi057.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 257 kB/s | 221 kB 00:00 2024-09-10T11:36:18.659 INFO:teuthology.orchestra.run.smithi057.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-10T11:36:18.743 INFO:teuthology.orchestra.run.smithi057.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2024-09-10T11:36:18.893 INFO:teuthology.orchestra.run.smithi057.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-10T11:36:19.011 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-10T11:36:19.163 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-10T11:36:19.164 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-10T11:36:19.343 INFO:teuthology.orchestra.run.smithi057.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-10T11:36:19.385 INFO:teuthology.orchestra.run.smithi057.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 99 kB/s | 64 kB 00:00 2024-09-10T11:36:19.444 INFO:teuthology.orchestra.run.smithi057.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-10T11:36:19.477 INFO:teuthology.orchestra.run.smithi057.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-10T11:36:19.519 INFO:teuthology.orchestra.run.smithi057.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-10T11:36:19.544 INFO:teuthology.orchestra.run.smithi057.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 843 kB/s | 19 kB 00:00 2024-09-10T11:36:19.586 INFO:teuthology.orchestra.run.smithi057.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-10T11:36:19.637 INFO:teuthology.orchestra.run.smithi057.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-09-10T11:36:19.662 INFO:teuthology.orchestra.run.smithi057.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-09-10T11:36:19.695 INFO:teuthology.orchestra.run.smithi057.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T11:36:19.729 INFO:teuthology.orchestra.run.smithi057.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-10T11:36:19.754 INFO:teuthology.orchestra.run.smithi057.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-09-10T11:36:19.796 INFO:teuthology.orchestra.run.smithi057.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-10T11:36:19.821 INFO:teuthology.orchestra.run.smithi057.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T11:36:19.847 INFO:teuthology.orchestra.run.smithi057.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T11:36:19.872 INFO:teuthology.orchestra.run.smithi057.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-10T11:36:19.897 INFO:teuthology.orchestra.run.smithi057.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-10T11:36:19.923 INFO:teuthology.orchestra.run.smithi057.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T11:36:19.956 INFO:teuthology.orchestra.run.smithi057.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-10T11:36:19.981 INFO:teuthology.orchestra.run.smithi057.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-10T11:36:20.006 INFO:teuthology.orchestra.run.smithi057.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T11:36:20.032 INFO:teuthology.orchestra.run.smithi057.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T11:36:20.057 INFO:teuthology.orchestra.run.smithi057.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-10T11:36:20.091 INFO:teuthology.orchestra.run.smithi057.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2024-09-10T11:36:20.108 INFO:teuthology.orchestra.run.smithi057.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-10T11:36:20.125 INFO:teuthology.orchestra.run.smithi057.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-10T11:36:20.142 INFO:teuthology.orchestra.run.smithi057.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-10T11:36:20.226 INFO:teuthology.orchestra.run.smithi057.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-09-10T11:36:20.242 INFO:teuthology.orchestra.run.smithi057.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-10T11:36:20.268 INFO:teuthology.orchestra.run.smithi057.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T11:36:20.293 INFO:teuthology.orchestra.run.smithi057.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T11:36:20.318 INFO:teuthology.orchestra.run.smithi057.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T11:36:20.343 INFO:teuthology.orchestra.run.smithi057.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-10T11:36:20.385 INFO:teuthology.orchestra.run.smithi057.stdout:(134/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-09-10T11:36:20.410 INFO:teuthology.orchestra.run.smithi057.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-10T11:36:20.436 INFO:teuthology.orchestra.run.smithi057.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T11:36:20.461 INFO:teuthology.orchestra.run.smithi057.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-10T11:36:20.486 INFO:teuthology.orchestra.run.smithi057.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-10T11:36:20.528 INFO:teuthology.orchestra.run.smithi057.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-09-10T11:36:20.553 INFO:teuthology.orchestra.run.smithi057.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2024-09-10T11:36:20.579 INFO:teuthology.orchestra.run.smithi057.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T11:36:20.604 INFO:teuthology.orchestra.run.smithi057.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-10T11:36:20.629 INFO:teuthology.orchestra.run.smithi057.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T11:36:20.654 INFO:teuthology.orchestra.run.smithi057.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T11:36:20.680 INFO:teuthology.orchestra.run.smithi057.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T11:36:20.705 INFO:teuthology.orchestra.run.smithi057.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T11:36:20.730 INFO:teuthology.orchestra.run.smithi057.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T11:36:20.772 INFO:teuthology.orchestra.run.smithi057.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-10T11:36:21.072 INFO:teuthology.orchestra.run.smithi057.stdout:(149/156): librbd1-19.3.0-4704.g8b38c33c.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-10T11:36:21.189 INFO:teuthology.orchestra.run.smithi057.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 5.6 MB/s | 2.3 MB 00:00 2024-09-10T11:36:21.240 INFO:teuthology.orchestra.run.smithi057.stdout:(151/156): librados2-19.3.0-4704.g8b38c33c.el9. 6.5 MB/s | 3.5 MB 00:00 2024-09-10T11:36:21.323 INFO:teuthology.orchestra.run.smithi057.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 305 kB/s | 41 kB 00:00 2024-09-10T11:36:21.415 INFO:teuthology.orchestra.run.smithi057.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 5.3 MB/s | 1.8 MB 00:00 2024-09-10T11:36:21.440 INFO:teuthology.orchestra.run.smithi057.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 1.2 MB/s | 249 kB 00:00 2024-09-10T11:36:21.550 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-10T11:36:21.550 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-10T11:36:21.590 INFO:teuthology.orchestra.run.smithi057.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-10T11:36:21.891 INFO:teuthology.orchestra.run.smithi057.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-09-10T11:36:21.898 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-09-10T11:36:21.898 INFO:teuthology.orchestra.run.smithi057.stdout:Total 9.7 MB/s | 240 MB 00:24 2024-09-10T11:36:23.176 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-09-10T11:36:23.348 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-09-10T11:36:23.348 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-09-10T11:36:25.757 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-09-10T11:36:25.757 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-09-10T11:36:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-10T11:36:28.046 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T11:36:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T11:36:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T11:36:28.188 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T11:36:28.213 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T11:36:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T11:36:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T11:36:28.764 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 8/164 2024-09-10T11:36:28.886 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 8/164 2024-09-10T11:36:28.915 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 9/164 2024-09-10T11:36:29.012 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 9/164 2024-09-10T11:36:29.045 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.3.0-4704.g8b38c33c.el9.x86_64 10/164 2024-09-10T11:36:29.225 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T11:36:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T11:36:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 13/164 2024-09-10T11:36:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 13/164 2024-09-10T11:36:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86 14/164 2024-09-10T11:36:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86 14/164 2024-09-10T11:36:29.538 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:36:29.563 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:36:29.741 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:36:29.924 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:36:30.053 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T11:36:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:36:30.263 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:36:30.483 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:36:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T11:36:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T11:36:30.661 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-09-10T11:36:30.734 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-09-10T11:36:30.787 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-09-10T11:36:30.844 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/164 2024-09-10T11:36:30.887 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-09-10T11:36:30.945 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-09-10T11:36:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-09-10T11:36:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-09-10T11:36:31.095 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/164 2024-09-10T11:36:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-09-10T11:36:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/164 2024-09-10T11:36:31.248 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/164 2024-09-10T11:36:31.279 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.3.0-4704.g8b38c33c.el9. 33/164 2024-09-10T11:36:31.324 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.3.0-4704.g8b38c33c.el 34/164 2024-09-10T11:36:31.351 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.3.0-4704.g8b38c33c.el9.x86_6 35/164 2024-09-10T11:36:31.421 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-09-10T11:36:31.474 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/164 2024-09-10T11:36:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-09-10T11:36:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-09-10T11:36:31.735 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-09-10T11:36:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-09-10T11:36:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-09-10T11:36:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/164 2024-09-10T11:36:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-09-10T11:36:32.457 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.3.0-4704.g8b38c33c.el9.x86_6 45/164 2024-09-10T11:36:32.498 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-09-10T11:36:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 47/164 2024-09-10T11:36:32.672 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-09-10T11:36:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 48/164 2024-09-10T11:36:32.795 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T11:36:32.818 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-09-10T11:36:32.842 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T11:36:32.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 50/164 2024-09-10T11:36:32.904 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T11:36:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T11:36:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T11:36:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T11:36:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T11:36:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T11:36:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T11:36:33.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T11:36:33.105 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T11:36:33.149 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T11:36:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T11:36:33.327 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T11:36:33.367 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T11:36:33.382 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T11:36:33.409 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T11:36:33.488 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 8/164 2024-09-10T11:36:33.511 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T11:36:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T11:36:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T11:36:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 8/164 2024-09-10T11:36:33.616 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T11:36:33.640 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T11:36:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T11:36:33.755 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 9/164 2024-09-10T11:36:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 9/164 2024-09-10T11:36:33.877 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T11:36:33.894 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:19.3.0-4704.g8b38c33c.el9.x86_64 10/164 2024-09-10T11:36:33.914 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T11:36:33.943 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T11:36:33.984 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T11:36:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T11:36:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T11:36:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 13/164 2024-09-10T11:36:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T11:36:34.267 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 13/164 2024-09-10T11:36:34.294 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86 14/164 2024-09-10T11:36:34.359 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T11:36:34.374 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86 14/164 2024-09-10T11:36:34.403 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:36:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T11:36:34.483 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T11:36:34.579 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T11:36:34.612 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T11:36:34.645 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T11:36:34.656 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:36:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T11:36:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T11:36:34.810 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T11:36:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T11:36:34.841 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T11:36:34.933 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T11:36:34.945 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T11:36:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T11:36:35.030 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:36:35.118 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:36:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T11:36:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T11:36:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T11:36:35.524 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-09-10T11:36:35.599 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-09-10T11:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-09-10T11:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/164 2024-09-10T11:36:35.733 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-09-10T11:36:35.752 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T11:36:35.766 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-09-10T11:36:35.793 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-09-10T11:36:35.805 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T11:36:35.843 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T11:36:35.865 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-09-10T11:36:35.926 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/164 2024-09-10T11:36:35.944 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T11:36:35.955 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-09-10T11:36:35.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T11:36:35.999 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/164 2024-09-10T11:36:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T11:36:36.079 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/164 2024-09-10T11:36:36.131 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T11:36:36.162 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T11:36:36.234 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:19.3.0-4704.g8b38c33c.el9. 33/164 2024-09-10T11:36:36.278 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:19.3.0-4704.g8b38c33c.el 34/164 2024-09-10T11:36:36.306 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:19.3.0-4704.g8b38c33c.el9.x86_6 35/164 2024-09-10T11:36:36.347 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T11:36:36.376 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T11:36:36.379 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-09-10T11:36:36.429 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/164 2024-09-10T11:36:36.460 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T11:36:36.506 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-09-10T11:36:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-09-10T11:36:36.707 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-09-10T11:36:37.123 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T11:36:37.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T11:36:37.262 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-09-10T11:36:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-09-10T11:36:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/164 2024-09-10T11:36:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-09-10T11:36:37.462 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:19.3.0-4704.g8b38c33c.el9.x86_6 45/164 2024-09-10T11:36:37.503 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-09-10T11:36:37.669 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 47/164 2024-09-10T11:36:37.723 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 48/164 2024-09-10T11:36:37.818 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-09-10T11:36:37.880 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 50/164 2024-09-10T11:36:37.952 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T11:36:37.991 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T11:36:38.027 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T11:36:38.075 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T11:36:38.118 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T11:36:38.162 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T11:36:38.203 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T11:36:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T11:36:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T11:36:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T11:36:38.518 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T11:36:38.536 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T11:36:38.571 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T11:36:38.612 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T11:36:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T11:36:38.641 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T11:36:38.644 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T11:36:38.669 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T11:36:38.674 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T11:36:38.769 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T11:36:38.900 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T11:36:38.963 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T11:36:38.993 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T11:36:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T11:36:39.037 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 101/164 2024-09-10T11:36:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T11:36:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T11:36:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T11:36:39.111 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 101/164 2024-09-10T11:36:39.139 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T11:36:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 102/164 2024-09-10T11:36:39.174 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T11:36:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T11:36:39.215 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T11:36:39.257 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T11:36:39.290 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T11:36:39.380 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T11:36:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T11:36:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T11:36:39.576 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T11:36:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T11:36:39.668 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T11:36:39.698 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 105/164 2024-09-10T11:36:39.752 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 105/164 2024-09-10T11:36:39.774 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 106/164 2024-09-10T11:36:40.393 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T11:36:40.442 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T11:36:40.476 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T11:36:40.579 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T11:36:40.635 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T11:36:40.679 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T11:36:40.769 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T11:36:40.814 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T11:36:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T11:36:41.037 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T11:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T11:36:41.809 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T11:36:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T11:36:42.130 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 107/164 2024-09-10T11:36:42.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 107/164 2024-09-10T11:36:42.719 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 107/164 2024-09-10T11:36:42.765 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 108/164 2024-09-10T11:36:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 108/164 2024-09-10T11:36:42.863 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T11:36:42.863 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T11:36:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:42.900 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 109/164 2024-09-10T11:36:43.254 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T11:36:43.338 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T11:36:43.366 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T11:36:43.399 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T11:36:43.743 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T11:36:43.787 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 101/164 2024-09-10T11:36:43.879 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 101/164 2024-09-10T11:36:43.909 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 102/164 2024-09-10T11:36:43.945 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T11:36:44.463 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T11:36:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 105/164 2024-09-10T11:36:44.552 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 105/164 2024-09-10T11:36:44.574 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 106/164 2024-09-10T11:36:47.017 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 107/164 2024-09-10T11:36:47.053 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 107/164 2024-09-10T11:36:47.651 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 107/164 2024-09-10T11:36:47.690 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 108/164 2024-09-10T11:36:47.765 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 108/164 2024-09-10T11:36:47.766 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T11:36:47.766 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T11:36:47.766 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:36:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 109/164 2024-09-10T11:36:54.713 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 109/164 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-10T11:36:54.714 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:54.930 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 110/164 2024-09-10T11:36:54.946 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 110/164 2024-09-10T11:36:54.946 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:36:54.946 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T11:36:54.946 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:56.457 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 111/164 2024-09-10T11:36:56.483 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 111/164 2024-09-10T11:36:56.483 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:36:56.483 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T11:36:56.483 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:36:56.484 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:36:56.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:56.716 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 112/164 2024-09-10T11:36:56.740 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 112/164 2024-09-10T11:36:56.740 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:36:56.740 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T11:36:56.740 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:36:56.741 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:36:56.741 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:57.184 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 113/164 2024-09-10T11:36:57.208 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 113/164 2024-09-10T11:36:57.208 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:36:57.208 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T11:36:57.208 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:36:57.208 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:36:57.208 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:36:57.322 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T11:36:57.379 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T11:36:57.435 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T11:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T11:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T11:36:57.745 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T11:36:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T11:36:57.973 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T11:36:58.015 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T11:36:58.049 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T11:36:58.077 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T11:36:58.517 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 125/164 2024-09-10T11:36:58.542 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 125/164 2024-09-10T11:36:58.574 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4704.g8b38c33c.e 126/164 2024-09-10T11:36:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4704.g8b38c33c. 127/164 2024-09-10T11:36:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noa 128/164 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 109/164 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-09-10T11:37:00.472 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /root 2024-09-10T11:37:00.473 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-09-10T11:37:00.473 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:00.652 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 110/164 2024-09-10T11:37:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 110/164 2024-09-10T11:37:00.668 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:00.668 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T11:37:00.668 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:01.866 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noa 128/164 2024-09-10T11:37:01.921 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.n 129/164 2024-09-10T11:37:02.346 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 111/164 2024-09-10T11:37:02.375 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 111/164 2024-09-10T11:37:02.375 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:02.375 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T11:37:02.375 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:37:02.375 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T11:37:02.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 112/164 2024-09-10T11:37:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 112/164 2024-09-10T11:37:02.632 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:02.632 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T11:37:02.632 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:37:02.632 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T11:37:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:02.882 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.n 129/164 2024-09-10T11:37:02.905 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b3 130/164 2024-09-10T11:37:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b3 130/164 2024-09-10T11:37:03.098 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 113/164 2024-09-10T11:37:03.124 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 113/164 2024-09-10T11:37:03.124 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:03.124 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T11:37:03.124 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:37:03.124 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T11:37:03.124 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:03.184 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4704.g8b38c33c.el 131/164 2024-09-10T11:37:03.215 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 132/164 2024-09-10T11:37:03.237 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T11:37:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 132/164 2024-09-10T11:37:03.240 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:03.240 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T11:37:03.240 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:37:03.240 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:37:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 133/164 2024-09-10T11:37:03.295 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T11:37:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 133/164 2024-09-10T11:37:03.359 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T11:37:03.399 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.3.0-4704.g8b38c33c.el9.x86_64 134/164 2024-09-10T11:37:03.466 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 135/164 2024-09-10T11:37:03.553 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T11:37:03.608 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T11:37:03.689 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T11:37:03.779 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T11:37:03.919 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T11:37:03.973 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T11:37:04.006 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T11:37:04.033 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T11:37:04.413 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T11:37:04.443 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 137/164 2024-09-10T11:37:04.467 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 137/164 2024-09-10T11:37:04.468 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:04.468 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T11:37:04.468 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:37:04.468 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:37:04.468 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4704.g8b38c 138/164 2024-09-10T11:37:04.515 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 125/164 2024-09-10T11:37:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4704.g8b38c 138/164 2024-09-10T11:37:04.533 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:04.534 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T11:37:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:04.540 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 125/164 2024-09-10T11:37:04.572 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4704.g8b38c33c.e 126/164 2024-09-10T11:37:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 139/164 2024-09-10T11:37:04.609 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 139/164 2024-09-10T11:37:04.610 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:04.610 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T11:37:04.610 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:37:04.610 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:37:04.610 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:04.641 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4704.g8b38c33c. 127/164 2024-09-10T11:37:04.671 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noa 128/164 2024-09-10T11:37:04.937 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 140/164 2024-09-10T11:37:04.961 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 140/164 2024-09-10T11:37:04.961 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:04.961 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T11:37:04.961 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:37:04.961 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:37:04.961 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:08.033 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noa 128/164 2024-09-10T11:37:08.084 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.n 129/164 2024-09-10T11:37:09.099 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.n 129/164 2024-09-10T11:37:09.127 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b3 130/164 2024-09-10T11:37:09.250 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b3 130/164 2024-09-10T11:37:09.421 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4704.g8b38c33c.el 131/164 2024-09-10T11:37:09.454 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 132/164 2024-09-10T11:37:09.480 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 132/164 2024-09-10T11:37:09.480 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:09.480 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T11:37:09.480 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:37:09.480 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T11:37:09.480 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:09.529 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 133/164 2024-09-10T11:37:09.542 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 133/164 2024-09-10T11:37:09.643 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:19.3.0-4704.g8b38c33c.el9.x86_64 134/164 2024-09-10T11:37:09.674 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.3.0-4704.g8b38c33c.el9.x86_64 141/164 2024-09-10T11:37:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 135/164 2024-09-10T11:37:09.715 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 142/164 2024-09-10T11:37:09.756 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 143/164 2024-09-10T11:37:09.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T11:37:09.815 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T11:37:10.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.3.0-4704.g8b38c33c.el9.x86_64 146/164 2024-09-10T11:37:10.062 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T11:37:10.083 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.3.0-4704.g8b38c33c.el9.x86_ 148/164 2024-09-10T11:37:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T11:37:10.151 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T11:37:10.706 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T11:37:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 137/164 2024-09-10T11:37:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 137/164 2024-09-10T11:37:10.757 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:10.757 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T11:37:10.757 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:37:10.757 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T11:37:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:10.788 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:37:10.799 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4704.g8b38c 138/164 2024-09-10T11:37:10.823 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4704.g8b38c 138/164 2024-09-10T11:37:10.823 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:10.823 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T11:37:10.823 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:10.832 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:37:10.853 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:37:10.882 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 139/164 2024-09-10T11:37:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 139/164 2024-09-10T11:37:10.908 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:10.908 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T11:37:10.908 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:37:10.908 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T11:37:10.908 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:11.233 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 140/164 2024-09-10T11:37:11.259 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 140/164 2024-09-10T11:37:11.259 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T11:37:11.259 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T11:37:11.259 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:37:11.259 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T11:37:11.259 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:11.696 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.3.0-4704.g8b38c33c.el9.noarch 152/164 2024-09-10T11:37:11.778 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T11:37:11.817 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T11:37:11.911 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T11:37:11.948 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T11:37:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T11:37:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T11:37:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:37:12.091 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:37:12.092 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:37:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:37:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T11:37:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:37:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:37:12.419 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:37:12.419 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:37:12.495 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:37:12.560 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:37:16.254 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:19.3.0-4704.g8b38c33c.el9.x86_64 141/164 2024-09-10T11:37:16.299 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 142/164 2024-09-10T11:37:16.353 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 143/164 2024-09-10T11:37:16.385 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T11:37:16.412 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T11:37:16.624 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-shell-2:19.3.0-4704.g8b38c33c.el9.x86_64 146/164 2024-09-10T11:37:16.667 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T11:37:16.697 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:19.3.0-4704.g8b38c33c.el9.x86_ 148/164 2024-09-10T11:37:16.726 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T11:37:16.781 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T11:37:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:37:17.403 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:37:17.424 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T11:37:18.340 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:19.3.0-4704.g8b38c33c.el9.noarch 152/164 2024-09-10T11:37:18.424 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T11:37:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T11:37:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T11:37:18.610 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T11:37:18.635 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T11:37:18.661 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T11:37:18.661 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:37:18.754 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T11:37:18.754 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:37:18.846 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T11:37:18.871 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T11:37:18.877 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:37:18.877 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:37:18.928 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:37:18.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.3.0-4704.g8b38c33c.el9.x86_64 1/164 2024-09-10T11:37:18.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 2/164 2024-09-10T11:37:18.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 3/164 2024-09-10T11:37:18.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 4/164 2024-09-10T11:37:18.929 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4704.g8b38c 5/164 2024-09-10T11:37:18.931 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 6/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 7/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 8/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 9/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 10/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 11/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.3.0-4704.g8b38c33c.el9.x86_64 12/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 13/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.3.0-4704.g8b38c33c.el9.x86_64 14/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.3.0-4704.g8b38c33c.el9.x86_ 15/164 2024-09-10T11:37:18.932 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 16/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 17/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.3.0-4704.g8b38c33c.el9.x86_6 18/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86 19/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 20/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4704.g8b38c33c.el 21/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.3.0-4704.g8b38c33c.el9. 22/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.3.0-4704.g8b38c33c.el9.x86_6 23/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.3.0-4704.g8b38c33c.el9.x86_64 24/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 25/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 26/164 2024-09-10T11:37:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 27/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 28/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 29/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4704.g8b38c33c. 30/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noa 31/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.n 32/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b3 33/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4704.g8b38c33c.el 34/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 35/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4704.g8b38c33c.e 36/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 37/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 38/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.3.0-4704.g8b38c33c.el9.noarch 39/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T11:37:18.934 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T11:37:18.935 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T11:37:18.936 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T11:37:18.937 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T11:37:18.938 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T11:37:18.939 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T11:37:18.940 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T11:37:18.941 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T11:37:18.942 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 149/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 151/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T11:37:18.943 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T11:37:18.944 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T11:37:18.944 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T11:37:18.944 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T11:37:18.944 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T11:37:18.944 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T11:37:19.064 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T11:37:19.065 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:37:19.157 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T11:37:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:37:21.493 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:37:21.493 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:21.493 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-10T11:37:21.493 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.494 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.495 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T11:37:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T11:37:21.497 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T11:37:21.498 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T11:37:21.500 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T11:37:21.501 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.502 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T11:37:21.503 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T11:37:21.504 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T11:37:21.505 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T11:37:21.505 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T11:37:21.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:21.505 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-10T11:37:21.982 DEBUG:teuthology.parallel:result is None 2024-09-10T11:37:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:37:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:19.3.0-4704.g8b38c33c.el9.x86_64 1/164 2024-09-10T11:37:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 2/164 2024-09-10T11:37:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 3/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 4/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4704.g8b38c 5/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 6/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 7/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 8/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 9/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 10/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 11/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:19.3.0-4704.g8b38c33c.el9.x86_64 12/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 13/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-shell-2:19.3.0-4704.g8b38c33c.el9.x86_64 14/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:19.3.0-4704.g8b38c33c.el9.x86_ 15/164 2024-09-10T11:37:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 16/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 17/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:19.3.0-4704.g8b38c33c.el9.x86_6 18/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86 19/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 20/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4704.g8b38c33c.el 21/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:19.3.0-4704.g8b38c33c.el9. 22/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:19.3.0-4704.g8b38c33c.el9.x86_6 23/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:19.3.0-4704.g8b38c33c.el9.x86_64 24/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 25/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 26/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 27/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 28/164 2024-09-10T11:37:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 29/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4704.g8b38c33c. 30/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noa 31/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.n 32/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b3 33/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4704.g8b38c33c.el 34/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 35/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4704.g8b38c33c.e 36/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 37/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 38/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:19.3.0-4704.g8b38c33c.el9.noarch 39/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T11:37:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T11:37:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T11:37:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T11:37:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T11:37:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T11:37:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T11:37:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T11:37:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T11:37:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T11:37:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 149/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 151/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T11:37:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T11:37:25.364 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T11:37:28.044 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.045 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.046 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-shell-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:19.3.0-4704.g8b38c33c.el9.noarch 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T11:37:28.047 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T11:37:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.050 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T11:37:28.051 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T11:37:28.052 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T11:37:28.053 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T11:37:28.054 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T11:37:28.055 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:19.3.0-4704.g8b38c33c.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T11:37:28.056 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T11:37:28.057 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T11:37:28.057 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:28.057 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-09-10T11:37:28.491 DEBUG:teuthology.parallel:result is None 2024-09-10T11:37:28.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:37:28.644 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T11:37:28.667 INFO:teuthology.orchestra.run.smithi057.stdout:19.3.0-4704.g8b38c33c.el9 2024-09-10T11:37:28.668 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4704.g8b38c33c.el9 2024-09-10T11:37:28.668 INFO:teuthology.task.install:The correct ceph version 19.3.0-4704.g8b38c33c is installed. 2024-09-10T11:37:28.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-10T11:37:28.810 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T11:37:28.837 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4704.g8b38c33c.el9 2024-09-10T11:37:28.838 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4704.g8b38c33c.el9 2024-09-10T11:37:28.838 INFO:teuthology.task.install:The correct ceph version 19.3.0-4704.g8b38c33c is installed. 2024-09-10T11:37:28.840 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T11:37:28.840 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:28.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:37:28.870 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:28.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T11:37:28.910 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T11:37:28.910 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:28.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:37:28.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:37:29.004 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:29.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T11:37:29.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T11:37:29.102 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T11:37:29.102 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:29.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:37:29.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:37:29.197 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:29.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T11:37:29.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T11:37:29.292 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T11:37:29.292 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:29.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:37:29.318 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:37:29.385 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:29.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T11:37:29.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T11:37:29.478 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T11:37:29.558 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T11:37:29.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-09-10T11:37:29.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-10T11:37:29.586 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T11:37:29.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T11:37:29.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T11:37:29.654 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T11:37:29.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T11:37:29.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T11:37:29.728 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T11:37:29.728 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T11:37:29.728 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T11:37:29.728 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:29.728 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T11:37:29.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T11:37:29.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T11:37:29.918 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:29.918 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T11:37:29.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T11:37:30.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T11:37:30.075 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T11:37:30.075 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T11:37:30.075 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097', 'branch': 'wip-athakkar-testing-2024-09-04-1837', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': None, 'first_in_suite': False, 'job_id': '7899097', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-04-1837'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-04-1837', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}}, 'owner': 'scheduled_khiremat@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9123, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-04-1837', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHI6ttIku/9HuTW7anc7yJ5UAyUZO1ZBZVtYzkxKLkHWDVKjR8KjLnCZCU/QVKpkVF2VuozrhN07cRYtveZ3HY=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL0hHeMDZSksbICWpsVN6i5turGFMDjsPbjDvvFGXZDzt0LoSR6KNPXE3cV9rr6UI4zU+KyzaPJFsmKgLjFGA6g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes', 'tasks.cephfs.test_subvolume']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_07:26:29', 'tube': 'smithi', 'user': 'khiremat', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T11:37:30.076 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T11:37:30.078 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T11:37:30.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T11:37:30.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T11:37:30.193 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:30.194 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:37:30.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:37:30.217 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-09-10 11:37:19.588525242 +0000 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-09-10 11:35:13.340084254 +0000 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-09-10 11:35:13.340084254 +0000 2024-09-10T11:37:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-09-10 11:35:13.340084254 +0000 2024-09-10T11:37:30.274 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:37:30.338 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-09-10T11:37:30.338 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-09-10T11:37:30.338 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000283179 s, 1.8 MB/s 2024-09-10T11:37:30.339 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:37:30.396 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-09-10T11:37:30.452 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:37:30.452 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:30.452 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T11:37:30.452 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:30.452 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:30.453 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-09-10 11:37:19.589525227 +0000 2024-09-10T11:37:30.453 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-09-10 11:35:13.679079140 +0000 2024-09-10T11:37:30.453 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-09-10 11:35:13.679079140 +0000 2024-09-10T11:37:30.453 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-09-10 11:35:13.679079140 +0000 2024-09-10T11:37:30.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:37:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-09-10T11:37:30.516 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-09-10T11:37:30.517 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000322415 s, 1.6 MB/s 2024-09-10T11:37:30.518 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:37:30.574 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-09-10T11:37:30.630 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:37:30.630 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:30.630 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T11:37:30.630 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:30.630 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:30.631 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-09-10 11:37:19.589525227 +0000 2024-09-10T11:37:30.631 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-09-10 11:35:14.018074026 +0000 2024-09-10T11:37:30.631 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-09-10 11:35:14.018074026 +0000 2024-09-10T11:37:30.631 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-09-10 11:35:14.018074026 +0000 2024-09-10T11:37:30.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:37:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-09-10T11:37:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-09-10T11:37:30.695 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000277555 s, 1.8 MB/s 2024-09-10T11:37:30.696 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:37:30.753 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-09-10T11:37:30.811 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:37:30.811 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:30.812 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T11:37:30.812 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:30.812 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:30.812 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-09-10 11:37:19.589525227 +0000 2024-09-10T11:37:30.812 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-09-10 11:35:14.373068671 +0000 2024-09-10T11:37:30.813 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-09-10 11:35:14.373068671 +0000 2024-09-10T11:37:30.813 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-09-10 11:35:14.373068671 +0000 2024-09-10T11:37:30.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:37:30.876 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-09-10T11:37:30.876 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-09-10T11:37:30.876 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000275657 s, 1.9 MB/s 2024-09-10T11:37:30.877 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:37:30.934 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:30.934 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:30.934 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T11:37:30.951 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T11:37:30.952 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-10T11:37:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T11:37:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:31.009 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T11:37:31.009 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:31.009 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:31.009 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 11:37:12.909077389 +0000 2024-09-10T11:37:31.010 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 11:35:10.609050822 +0000 2024-09-10T11:37:31.010 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 11:35:10.609050822 +0000 2024-09-10T11:37:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 11:35:10.609050822 +0000 2024-09-10T11:37:31.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T11:37:31.073 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T11:37:31.073 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T11:37:31.073 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000240592 s, 2.1 MB/s 2024-09-10T11:37:31.074 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T11:37:31.131 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-10T11:37:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T11:37:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:31.187 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T11:37:31.187 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:31.188 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:31.188 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 11:37:12.909077389 +0000 2024-09-10T11:37:31.188 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 11:35:10.938042030 +0000 2024-09-10T11:37:31.188 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 11:35:10.938042030 +0000 2024-09-10T11:37:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 11:35:10.938042030 +0000 2024-09-10T11:37:31.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T11:37:31.250 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T11:37:31.250 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T11:37:31.250 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000199694 s, 2.6 MB/s 2024-09-10T11:37:31.251 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T11:37:31.308 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-10T11:37:31.363 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T11:37:31.363 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:31.363 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T11:37:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 11:37:12.909077389 +0000 2024-09-10T11:37:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 11:35:11.253033611 +0000 2024-09-10T11:37:31.364 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 11:35:11.253033611 +0000 2024-09-10T11:37:31.364 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 11:35:11.253033611 +0000 2024-09-10T11:37:31.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T11:37:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T11:37:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T11:37:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000240663 s, 2.1 MB/s 2024-09-10T11:37:31.428 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T11:37:31.484 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-10T11:37:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T11:37:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 11:37:12.910077363 +0000 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 11:35:11.586024712 +0000 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 11:35:11.586024712 +0000 2024-09-10T11:37:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 11:35:11.586024712 +0000 2024-09-10T11:37:31.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T11:37:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T11:37:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T11:37:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000312922 s, 1.6 MB/s 2024-09-10T11:37:31.606 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T11:37:31.662 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:31.662 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T11:37:31.662 INFO:tasks.ceph:Generating config... 2024-09-10T11:37:31.663 INFO:tasks.ceph:[client] pid file = 2024-09-10T11:37:31.663 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-10T11:37:31.663 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T11:37:31.664 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T11:37:31.664 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T11:37:31.664 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T11:37:31.664 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T11:37:31.664 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T11:37:31.664 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T11:37:31.664 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T11:37:31.665 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T11:37:31.665 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T11:37:31.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T11:37:31.717 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T11:37:31.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T11:37:31.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T11:37:31.793 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.154'), ('mon.c', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]')] 2024-09-10T11:37:31.793 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T11:37:31.794 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:31.794 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T11:37:31.849 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.154 --addv c '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 7a594499-0d72-4dbb-a3a3-20517d473caf 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = quincy 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 7a594499-0d72-4dbb-a3a3-20517d473caf 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-09-10T11:37:31.938888+0000 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-09-10T11:37:31.938888+0000 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 17 (quincy) 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.c 2024-09-10T11:37:31.939 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T11:37:31.941 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T11:37:31.956 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7a594499-0d72-4dbb-a3a3-20517d473caf... 2024-09-10T11:37:31.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T11:37:31.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.041 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-09-10T11:37:32.042 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-09-10T11:37:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 7a594499-0d72-4dbb-a3a3-20517d473caf 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.044 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-09-10T11:37:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2024-09-10T11:37:32.046 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-09-10T11:37:32.047 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 30 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug finisher = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-09-10T11:37:32.048 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T11:37:32.049 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: mon down mkfs grace = 300 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-09-10T11:37:32.050 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-10T11:37:32.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T11:37:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-10T11:37:32.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.57,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 7a594499-0d72-4dbb-a3a3-20517d473caf 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.054 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-10T11:37:32.055 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-09-10T11:37:32.056 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-10T11:37:32.057 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 30 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug finisher = 20 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-10T11:37:32.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.059 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-10T11:37:32.060 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-09-10T11:37:32.061 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-09-10T11:37:32.062 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T11:37:32.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T11:37:32.159 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T11:37:32.159 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:32.159 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T11:37:32.174 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:32.175 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T11:37:32.230 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:37:32.230 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:32.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T11:37:32.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T11:37:32.306 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:37:32.307 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:32.363 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:37:32.363 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:32.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T11:37:32.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T11:37:32.398 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:37:32.398 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:32.455 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T11:37:32.455 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T11:37:32.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T11:37:32.507 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T11:37:32.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T11:37:32.570 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T11:37:32.574 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T11:37:32.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T11:37:32.627 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T11:37:32.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T11:37:32.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T11:37:32.748 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T11:37:32.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T11:37:32.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T11:37:32.828 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T11:37:32.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T11:37:32.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T11:37:32.946 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T11:37:32.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T11:37:32.973 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T11:37:32.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T11:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T11:37:33.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T11:37:33.113 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T11:37:33.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T11:37:33.175 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T11:37:33.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T11:37:33.230 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T11:37:33.243 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T11:37:33.243 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T11:37:33.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T11:37:33.269 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:33.269 INFO:tasks.ceph:role: osd.0 2024-09-10T11:37:33.270 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:37:33.270 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:33.364 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:34.686 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-09-10T11:37:34.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-09-10T11:37:34.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T11:37:34.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T11:37:34.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T11:37:34.873 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:34.874 INFO:tasks.ceph:role: osd.1 2024-09-10T11:37:34.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:37:34.874 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:34.969 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:36.289 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-09-10T11:37:36.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-09-10T11:37:36.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T11:37:36.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T11:37:36.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T11:37:36.473 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:36.473 INFO:tasks.ceph:role: osd.2 2024-09-10T11:37:36.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:37:36.474 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T11:37:36.569 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:36.569 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:36.570 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:36.570 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:36.570 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:37.886 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-09-10T11:37:37.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-09-10T11:37:37.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T11:37:37.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T11:37:38.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T11:37:38.071 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:38.071 INFO:tasks.ceph:role: osd.3 2024-09-10T11:37:38.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:37:38.072 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T11:37:38.169 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:38.169 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:38.170 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:38.170 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:38.170 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:38.170 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:38.170 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:38.170 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:39.485 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-09-10T11:37:39.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-09-10T11:37:39.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T11:37:39.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T11:37:39.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:39.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:39.712+0000 7fd96f087640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T11:37:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:39.713+0000 7fd96f087640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T11:37:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:39.713+0000 7fd96f087640 -1 bdev(0x5566bc0c5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T11:37:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:39.713+0000 7fd96f087640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T11:37:42.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T11:37:42.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:43.029+0000 7efd4a0ed640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T11:37:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:43.029+0000 7efd4a0ed640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T11:37:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:43.029+0000 7efd4a0ed640 -1 bdev(0x555692a1b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T11:37:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:43.029+0000 7efd4a0ed640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T11:37:45.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T11:37:45.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:46.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:46.079+0000 7fef04d51640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T11:37:46.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:46.079+0000 7fef04d51640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T11:37:46.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:46.079+0000 7fef04d51640 -1 bdev(0x55e46e305800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T11:37:46.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:46.079+0000 7fef04d51640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T11:37:49.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T11:37:49.273 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:49.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:49.366+0000 7fef42302640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T11:37:49.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:49.366+0000 7fef42302640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T11:37:49.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:49.366+0000 7fef42302640 -1 bdev(0x5585557d5800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T11:37:49.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:37:49.366+0000 7fef42302640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T11:37:52.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T11:37:52.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T11:37:52.589 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:52.589 INFO:tasks.ceph:role: osd.4 2024-09-10T11:37:52.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:37:52.589 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:52.665 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:52.666 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:52.666 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:53.178 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T11:37:53.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T11:37:53.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T11:37:53.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T11:37:53.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T11:37:53.416 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:53.416 INFO:tasks.ceph:role: osd.5 2024-09-10T11:37:53.416 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:37:53.416 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T11:37:53.489 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:53.490 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:53.943 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T11:37:53.945 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T11:37:53.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T11:37:54.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T11:37:54.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T11:37:54.131 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:54.131 INFO:tasks.ceph:role: osd.6 2024-09-10T11:37:54.131 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:37:54.131 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T11:37:54.204 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:54.205 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:54.687 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T11:37:54.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T11:37:54.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T11:37:54.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T11:37:54.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T11:37:54.919 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T11:37:54.920 INFO:tasks.ceph:role: osd.7 2024-09-10T11:37:54.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:37:54.920 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T11:37:54.992 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T11:37:54.993 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T11:37:55.495 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T11:37:55.498 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T11:37:55.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T11:37:55.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T11:37:55.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:55.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:55.776+0000 7ff69c1c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T11:37:55.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:55.776+0000 7ff69c1c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T11:37:55.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:55.776+0000 7ff69c1c5640 -1 bdev(0x5557da027800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T11:37:55.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:55.776+0000 7ff69c1c5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T11:37:59.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T11:37:59.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:37:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:59.307+0000 7fdec2cfe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T11:37:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:59.307+0000 7fdec2cfe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T11:37:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:59.307+0000 7fdec2cfe640 -1 bdev(0x55ed90d41800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T11:37:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:37:59.307+0000 7fdec2cfe640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T11:38:00.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:38:00.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:38:02.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T11:38:02.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:38:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:02.355+0000 7f48e960d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T11:38:02.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:02.355+0000 7f48e960d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T11:38:02.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:02.355+0000 7f48e960d640 -1 bdev(0x564e99761800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T11:38:02.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:02.355+0000 7f48e960d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T11:38:05.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T11:38:05.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:38:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:05.654+0000 7f357160d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T11:38:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:05.654+0000 7f357160d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T11:38:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:05.654+0000 7f357160d640 -1 bdev(0x5565562b3800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T11:38:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:05.654+0000 7f357160d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T11:38:08.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T11:38:08.587 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T11:38:08.587 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T11:38:08.618 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T11:38:08.689 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T11:38:08.758 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T11:38:08.828 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T11:38:08.897 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T11:38:08.965 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:08.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T11:38:09.033 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T11:38:09.062 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T11:38:09.131 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T11:38:09.199 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T11:38:09.266 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T11:38:09.332 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T11:38:09.398 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T11:38:09.463 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:09.463 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T11:38:09.482 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:09.483 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T11:38:09.541 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.541 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T11:38:09.557 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:09.557 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T11:38:09.612 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T11:38:09.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T11:38:09.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T11:38:09.655 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2024-09-10T11:38:09.655 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB8L+Bmqww/HhAATI9+i6UZ/oIoYMUiM3h3rA== 2024-09-10T11:38:09.655 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-09-10T11:38:09.655 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB8L+BmFNRjJRAAMflcnkCOITp3wLuXcehS8Q== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB8L+BmsvueLBAAdihTDKwXPfYyBOJACDfg3Q== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCDL+BmsA2BKhAAjy54qbTmcANROSnoQTusTw== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCHL+BmXI/EARAAPyMq7zZUlxog/KC2u3Eb9g== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCKL+BmvRvCBBAAoGCpDT82n26WVxg1RPHXyQ== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCNL+Bmt4baFRAAAXY6XdNrThTSJn1tlUN6Ww== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB8L+BmmQ0GIhAAXCPvLRLEK7U3udgGITUHSQ== 2024-09-10T11:38:09.656 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB8L+BmZpFbMRAA6fGyqZviCNHbJNhwvt1s4Q== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB8L+BmiGZnOBAA3MxuPUZwBRMgfm7nU5SBkg== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCTL+BmyZ5QLhAARScYbrsDToCupxQFlQTGwA== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCXL+BmZ2dhEhAAsGhoNn+NlOhks6Rk0iKLjg== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCaL+BmipI5FRAA5kqyebYVV+1eGNQQaxb0lw== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCdL+Bmlb0PJxAAhG7/RROYpOP+iSTw5M+h8g== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB9L+BmrGkGARAAhUxqu7mvHXYZ9uNMNAXV+A== 2024-09-10T11:38:09.657 INFO:teuthology.orchestra.run.smithi057.stdout:[client.2] 2024-09-10T11:38:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB9L+Bmy2y/BhAAi7NJduZPhp6eVdzkDuCtXA== 2024-09-10T11:38:09.658 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2024-09-10T11:38:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB9L+BmQBV3ChAAiAm195V683dZlXDzjRUOig== 2024-09-10T11:38:09.658 INFO:teuthology.orchestra.run.smithi057.stdout:[client.3] 2024-09-10T11:38:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQB9L+Bmhs60DRAAeL4+tTZVl+RB1u7AfqJ6Gg== 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB8L+Bmqww/HhAATI9+i6UZ/oIoYMUiM3h3rA== 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB8L+BmFNRjJRAAMflcnkCOITp3wLuXcehS8Q== 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB8L+BmsvueLBAAdihTDKwXPfYyBOJACDfg3Q== 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-09-10T11:38:09.675 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCDL+BmsA2BKhAAjy54qbTmcANROSnoQTusTw== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCHL+BmXI/EARAAPyMq7zZUlxog/KC2u3Eb9g== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCKL+BmvRvCBBAAoGCpDT82n26WVxg1RPHXyQ== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCNL+Bmt4baFRAAAXY6XdNrThTSJn1tlUN6Ww== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB8L+BmmQ0GIhAAXCPvLRLEK7U3udgGITUHSQ== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB8L+BmZpFbMRAA6fGyqZviCNHbJNhwvt1s4Q== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB8L+BmiGZnOBAA3MxuPUZwBRMgfm7nU5SBkg== 2024-09-10T11:38:09.676 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCTL+BmyZ5QLhAARScYbrsDToCupxQFlQTGwA== 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCXL+BmZ2dhEhAAsGhoNn+NlOhks6Rk0iKLjg== 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCaL+BmipI5FRAA5kqyebYVV+1eGNQQaxb0lw== 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQCdL+Bmlb0PJxAAhG7/RROYpOP+iSTw5M+h8g== 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB9L+BmrGkGARAAhUxqu7mvHXYZ9uNMNAXV+A== 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB9L+Bmy2y/BhAAi7NJduZPhp6eVdzkDuCtXA== 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-09-10T11:38:09.677 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB9L+BmQBV3ChAAiAm195V683dZlXDzjRUOig== 2024-09-10T11:38:09.678 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2024-09-10T11:38:09.678 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB9L+Bmhs60DRAAeL4+tTZVl+RB1u7AfqJ6Gg== 2024-09-10T11:38:09.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:38:09.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:38:09.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:09.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:09.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:09.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:09.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:09.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:09.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:09.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:09.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:09.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:38:10.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T11:38:10.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:10.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:10.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:10.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T11:38:10.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T11:38:10.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T11:38:10.706 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T11:38:10.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T11:38:10.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T11:38:10.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T11:38:10.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T11:38:10.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T11:38:10.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T11:38:11.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T11:38:11.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T11:38:11.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T11:38:11.197 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:38:11.199 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T11:38:11.252 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T11:38:11.253 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T11:38:11.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T11:38:11.256 INFO:tasks.ceph.mon.a:Started 2024-09-10T11:38:11.256 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T11:38:11.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T11:38:11.294 INFO:tasks.ceph.mon.b:Started 2024-09-10T11:38:11.295 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T11:38:11.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T11:38:11.297 INFO:tasks.ceph.mon.c:Started 2024-09-10T11:38:11.297 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T11:38:11.297 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T11:38:11.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T11:38:11.299 INFO:tasks.ceph.mgr.y:Started 2024-09-10T11:38:11.299 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T11:38:11.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T11:38:11.301 INFO:tasks.ceph.mgr.x:Started 2024-09-10T11:38:11.302 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T11:38:11.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T11:38:11.304 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T11:38:11.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T11:38:11.346 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T11:38:11.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T11:38:11.389 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T11:38:11.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T11:38:11.432 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T11:38:11.433 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T11:38:11.475 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T11:38:11.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T11:38:11.518 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T11:38:11.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T11:38:11.561 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T11:38:11.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T11:38:11.606 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T11:38:11.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T11:38:11.649 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T11:38:11.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T11:38:11.692 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T11:38:11.692 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T11:38:11.736 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T11:38:11.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T11:38:11.762 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T11:38:11.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T11:38:11.774 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T11:38:11.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T11:38:11.803 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T11:38:11.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T11:38:11.846 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T11:38:11.847 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T11:38:11.858 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T11:38:11.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T11:38:11.902 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T11:38:11.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T11:38:11.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 -- 172.21.15.57:0/3475076414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c15b640 msgr2=0x7faf3c15d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 --2- 172.21.15.57:0/3475076414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c15b640 0x7faf3c15d080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faf30010a70 tx=0x7faf30010f30 comp rx=0 tx=0).stop 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 -- 172.21.15.57:0/3475076414 shutdown_connections 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 --2- 172.21.15.57:0/3475076414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf3c15ba20 0x7faf3c0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 --2- 172.21.15.57:0/3475076414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c15b640 0x7faf3c15d080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 --2- 172.21.15.57:0/3475076414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0d02b0 0x7faf3c0b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 -- 172.21.15.57:0/3475076414 >> 172.21.15.57:0/3475076414 conn(0x7faf3c0d09e0 msgr2=0x7faf3c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 -- 172.21.15.57:0/3475076414 shutdown_connections 2024-09-10T11:38:11.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.901+0000 7faf21ffb640 1 -- 172.21.15.57:0/3475076414 wait complete. 2024-09-10T11:38:11.905 DEBUG:tasks.ceph:set 18 configs 2024-09-10T11:38:11.905 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.906 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.906 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi057') 2024-09-10T11:38:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.941+0000 7fd105423640 1 -- 172.21.15.57:0/1052379271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cf20 msgr2=0x7fd1000cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.941+0000 7fd105423640 1 --2- 172.21.15.57:0/1052379271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cf20 0x7fd1000cb8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009830 tx=0x7fd0f402a3b0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.943+0000 7fd105423640 1 -- 172.21.15.57:0/1052379271 shutdown_connections 2024-09-10T11:38:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.943+0000 7fd105423640 1 --2- 172.21.15.57:0/1052379271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cf20 0x7fd1000cb8c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.943+0000 7fd105423640 1 --2- 172.21.15.57:0/1052379271 >> v2:172.21.15.57:3300/0 conn(0x7fd10006cb40 0x7fd1000c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.943+0000 7fd105423640 1 -- 172.21.15.57:0/1052379271 >> 172.21.15.57:0/1052379271 conn(0x7fd1000cf9a0 msgr2=0x7fd1000cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.943+0000 7fd105423640 1 -- 172.21.15.57:0/1052379271 shutdown_connections 2024-09-10T11:38:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.943+0000 7fd105423640 1 -- 172.21.15.57:0/1052379271 wait complete. 2024-09-10T11:38:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.945+0000 7fd105423640 1 Processor -- start 2024-09-10T11:38:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.945+0000 7fd105423640 1 -- start start 2024-09-10T11:38:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.946+0000 7fd105423640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 0x7fd100160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.946+0000 7fd105423640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10006cf20 0x7fd100152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd105423640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10006f450 0x7fd1001603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd105423640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001620a0 con 0x7fd10006f450 2024-09-10T11:38:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd105423640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd100070040 con 0x7fd10006cf20 2024-09-10T11:38:11.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd105423640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd100162220 con 0x7fd10006cb40 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 0x7fd100160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 0x7fd100160b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:33728/0 (socket says 172.21.15.57:33728) 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0fffff640 1 -- 172.21.15.57:0/1243985670 learned_addr learned my addr 172.21.15.57:0/1243985670 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0ff7fe640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10006cf20 0x7fd100152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0fffff640 1 -- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10006cf20 msgr2=0x7fd100152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0fffff640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10006cf20 0x7fd100152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.947+0000 7fd0fffff640 1 -- 172.21.15.57:0/1243985670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10006f450 msgr2=0x7fd1001603b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.952+0000 7fd104c22640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10006f450 0x7fd1001603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:11.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.952+0000 7fd0fffff640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10006f450 0x7fd1001603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.952+0000 7fd0fffff640 1 -- 172.21.15.57:0/1243985670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1001611a0 con 0x7fd10006cb40 2024-09-10T11:38:11.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.952+0000 7fd104c22640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10006f450 0x7fd1001603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:11.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.953+0000 7fd0fffff640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 0x7fd100160b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800ed80 tx=0x7fd0f800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:11.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.961+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f801c070 con 0x7fd10006cb40 2024-09-10T11:38:11.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.961+0000 7fd105423640 1 -- 172.21.15.57:0/1243985670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10015f1e0 con 0x7fd10006cb40 2024-09-10T11:38:11.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.961+0000 7fd105423640 1 -- 172.21.15.57:0/1243985670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1001608f0 con 0x7fd10006cb40 2024-09-10T11:38:11.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.961+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0f8017730 con 0x7fd10006cb40 2024-09-10T11:38:11.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.961+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8017b40 con 0x7fd10006cb40 2024-09-10T11:38:11.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.964+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0f801f070 con 0x7fd10006cb40 2024-09-10T11:38:11.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.964+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd0f800f400 con 0x7fd10006cb40 2024-09-10T11:38:11.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.965+0000 7f51b4b6c640 1 -- 172.21.15.57:0/1240305595 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f5188005180 con 0x7f51b00b1a00 2024-09-10T11:38:11.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.967+0000 7fd105423640 1 -- 172.21.15.57:0/1243985670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e0005290 con 0x7fd10006cb40 2024-09-10T11:38:11.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.971+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd0f8021440 con 0x7fd10006cb40 2024-09-10T11:38:11.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.972+0000 7f519effd640 1 -- 172.21.15.57:0/1240305595 <== mon.0 v2:172.21.15.57:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f51a80048a0 con 0x7f51b00b1a00 2024-09-10T11:38:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.978+0000 7f51b4b6c640 1 -- 172.21.15.57:0/1240305595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b00b1a00 msgr2=0x7f51b00b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.978+0000 7f51b4b6c640 1 --2- 172.21.15.57:0/1240305595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b00b1a00 0x7f51b00b1e80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5198003a00 tx=0x7f51a800ed80 comp rx=0 tx=0).stop 2024-09-10T11:38:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.978+0000 7f7e55907640 1 -- 172.21.15.57:0/1469165325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e500cf880 msgr2=0x7f7e5015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.978+0000 7f7e55907640 1 --2- 172.21.15.57:0/1469165325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e500cf880 0x7f7e5015eb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7e500cf3d0 tx=0x7f7e4002a610 comp rx=0 tx=0).stop 2024-09-10T11:38:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f51b4b6c640 1 -- 172.21.15.57:0/1240305595 shutdown_connections 2024-09-10T11:38:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f51b4b6c640 1 --2- 172.21.15.57:0/1240305595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b00b1a00 0x7f51b00b1e80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f51b4b6c640 1 --2- 172.21.15.57:0/1240305595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b0146a40 0x7f51b00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f51b4b6c640 1 --2- 172.21.15.57:0/1240305595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b0146660 0x7f51b0146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f51b4b6c640 1 -- 172.21.15.57:0/1240305595 >> 172.21.15.57:0/1240305595 conn(0x7f51b006c8d0 msgr2=0x7f51b014c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 -- 172.21.15.57:0/1469165325 shutdown_connections 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 --2- 172.21.15.57:0/1469165325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e50161bf0 0x7f7e50162080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 --2- 172.21.15.57:0/1469165325 >> v2:172.21.15.154:3300/0 conn(0x7f7e500cfc60 0x7f7e501616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 --2- 172.21.15.57:0/1469165325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e500cf880 0x7f7e5015eb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 -- 172.21.15.57:0/1469165325 >> 172.21.15.57:0/1469165325 conn(0x7f7e5006c8d0 msgr2=0x7f7e5006cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:11.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 -- 172.21.15.57:0/1469165325 shutdown_connections 2024-09-10T11:38:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.980+0000 7f7e55907640 1 -- 172.21.15.57:0/1469165325 wait complete. 2024-09-10T11:38:11.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.982+0000 7f7e55907640 1 Processor -- start 2024-09-10T11:38:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.982+0000 7f7e55907640 1 -- start start 2024-09-10T11:38:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.983+0000 7f7e55907640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e500cf880 0x7f7e501497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.983+0000 7f7e55907640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 0x7f7e500ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f51b4b6c640 1 -- 172.21.15.57:0/1240305595 shutdown_connections 2024-09-10T11:38:11.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f51b4b6c640 1 -- 172.21.15.57:0/1240305595 wait complete. 2024-09-10T11:38:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.983+0000 7f7e55907640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e50161bf0 0x7f7e5015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:11.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.983+0000 7f7e55907640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5014ffe0 con 0x7f7e50161bf0 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f7e55907640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e50072e90 con 0x7f7e500cfc60 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f7e55907640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7e50150160 con 0x7f7e500cf880 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f7e4e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 0x7f7e500ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f7e4e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 0x7f7e500ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:42442/0 (socket says 172.21.15.57:42442) 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.984+0000 7f7e4e7fc640 1 -- 172.21.15.57:0/998920168 learned_addr learned my addr 172.21.15.57:0/998920168 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.985+0000 7f7e4f7fe640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e50161bf0 0x7f7e5015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.987+0000 7f7e4e7fc640 1 -- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e500cf880 msgr2=0x7f7e501497a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:11.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.987+0000 7f7e4e7fc640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e500cf880 0x7f7e501497a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.987+0000 7f7e4e7fc640 1 -- 172.21.15.57:0/998920168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e50161bf0 msgr2=0x7f7e5015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.987+0000 7f7e4e7fc640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e50161bf0 0x7f7e5015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:11.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.987+0000 7f7e4e7fc640 1 -- 172.21.15.57:0/998920168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e500cd490 con 0x7f7e500cfc60 2024-09-10T11:38:11.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.987+0000 7f7e4f7fe640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e50161bf0 0x7f7e5015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:11.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.989+0000 7f7e4e7fc640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 0x7f7e500ceba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800ebc0 tx=0x7f7e4800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f579348d640 1 -- 172.21.15.57:0/575395083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 msgr2=0x7f577800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f579348d640 1 --2- 172.21.15.57:0/575395083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 0x7f577800b9c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f578c000b60 tx=0x7f5778005830 comp rx=0 tx=0).stop 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f5792c8c640 1 -- 172.21.15.57:0/575395083 reap_dead start 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48010630 con 0x7f7e500cfc60 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e500cd770 con 0x7f7e500cfc60 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e500cdd30 con 0x7f7e500cfc60 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e480108c0 con 0x7f7e500cfc60 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.993+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48010d10 con 0x7f7e500cfc60 2024-09-10T11:38:11.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.995+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7e48018420 con 0x7f7e500cfc60 2024-09-10T11:38:11.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.995+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e30005290 con 0x7f7e500cfc60 2024-09-10T11:38:11.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:11.995+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7e48021510 con 0x7f7e500cfc60 2024-09-10T11:38:12.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.001+0000 7f579348d640 1 -- 172.21.15.57:0/575395083 shutdown_connections 2024-09-10T11:38:12.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.001+0000 7f579348d640 1 -- 172.21.15.57:0/575395083 >> 172.21.15.57:0/575395083 conn(0x7f5784054550 msgr2=0x7f5784054930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.005+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7e48018710 con 0x7f7e500cfc60 2024-09-10T11:38:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.006+0000 7fe10545d640 1 -- 172.21.15.57:0/3900297628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 msgr2=0x7fe0f8033e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.006+0000 7fe10545d640 1 --2- 172.21.15.57:0/3900297628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f8033e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe10007ac50 tx=0x7fe1000a5c00 comp rx=0 tx=0).stop 2024-09-10T11:38:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.009+0000 7fe10545d640 1 -- 172.21.15.57:0/3900297628 shutdown_connections 2024-09-10T11:38:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.009+0000 7fe10545d640 1 --2- 172.21.15.57:0/3900297628 >> v2:172.21.15.57:3300/0 conn(0x7fe0f80e31d0 0x7fe0f8035ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.009+0000 7fe10545d640 1 --2- 172.21.15.57:0/3900297628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f8033e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.009+0000 7fe10545d640 1 -- 172.21.15.57:0/3900297628 >> 172.21.15.57:0/3900297628 conn(0x7fe0f801d760 msgr2=0x7fe0f8054550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.011+0000 7fe10545d640 1 -- 172.21.15.57:0/3900297628 shutdown_connections 2024-09-10T11:38:12.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.014+0000 7fe10545d640 1 -- 172.21.15.57:0/3900297628 wait complete. 2024-09-10T11:38:12.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.015+0000 7fe10545d640 1 Processor -- start 2024-09-10T11:38:12.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.020+0000 7f579348d640 1 -- 172.21.15.57:0/575395083 shutdown_connections 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.016+0000 7fe10545d640 1 -- start start 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.017+0000 7fe10545d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f80351a0 0x7fe0f80d58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.017+0000 7fe10545d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f80320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.017+0000 7fe10545d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0f80e31d0 0x7fe0f80d8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.017+0000 7fe10545d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80367a0 con 0x7fe0f80351a0 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.017+0000 7fe10545d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f8036620 con 0x7fe0f80e2df0 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.017+0000 7fe10545d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f8036920 con 0x7fe0f80e31d0 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f80351a0 0x7fe0f80d58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0ff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f80320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0ff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f80320a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:42474/0 (socket says 172.21.15.57:42474) 2024-09-10T11:38:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0ff7fe640 1 -- 172.21.15.57:0/780154853 learned_addr learned my addr 172.21.15.57:0/780154853 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0fffff640 1 -- 172.21.15.57:0/780154853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0f80e31d0 msgr2=0x7fe0f80d8450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0fffff640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0f80e31d0 0x7fe0f80d8450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0fffff640 1 -- 172.21.15.57:0/780154853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 msgr2=0x7fe0f80320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0fffff640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f80320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.024+0000 7f579348d640 1 -- 172.21.15.57:0/575395083 wait complete. 2024-09-10T11:38:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.019+0000 7fe0fffff640 1 -- 172.21.15.57:0/780154853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f80e0460 con 0x7fe0f80351a0 2024-09-10T11:38:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.022+0000 7fe0fffff640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f80351a0 0x7fe0f80d58b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1000663d0 tx=0x7fe10006c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.024+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000b3050 con 0x7fe0f80351a0 2024-09-10T11:38:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.024+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f80e0740 con 0x7fe0f80351a0 2024-09-10T11:38:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.026+0000 7f579348d640 1 Processor -- start 2024-09-10T11:38:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.024+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f80e0d00 con 0x7fe0f80351a0 2024-09-10T11:38:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.026+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1000e1070 con 0x7fe0f80351a0 2024-09-10T11:38:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.027+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000adb20 con 0x7fe0f80351a0 2024-09-10T11:38:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.027+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1000add40 con 0x7fe0f80351a0 2024-09-10T11:38:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.028+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe1000e64a0 con 0x7fe0f80351a0 2024-09-10T11:38:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.028+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e0005290 con 0x7fe0f80351a0 2024-09-10T11:38:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.032+0000 7f579348d640 1 -- start start 2024-09-10T11:38:12.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f10bbce6640 1 -- 172.21.15.57:0/1917717309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a0003dc0 msgr2=0x7f10a00041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f10bbce6640 1 --2- 172.21.15.57:0/1917717309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a0003dc0 0x7f10a00041c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000b60 tx=0x7f10a0003810 comp rx=0 tx=0).stop 2024-09-10T11:38:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f10ba283640 1 -- 172.21.15.57:0/1917717309 reap_dead start 2024-09-10T11:38:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe1000a6ac0 con 0x7fe0f80351a0 2024-09-10T11:38:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f10bbce6640 1 -- 172.21.15.57:0/1917717309 shutdown_connections 2024-09-10T11:38:12.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f10bbce6640 1 -- 172.21.15.57:0/1917717309 >> 172.21.15.57:0/1917717309 conn(0x7f10ac054550 msgr2=0x7f10ac054930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f579348d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 0x7f57840e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.033+0000 7f579348d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 0x7f57840ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.037+0000 7f10bbce6640 1 -- 172.21.15.57:0/1917717309 shutdown_connections 2024-09-10T11:38:12.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.038+0000 7f579248b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 0x7f57840e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.038+0000 7f5791c8a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 0x7f57840ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.038+0000 7f5791c8a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 0x7f57840ddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33296/0 (socket says 172.21.15.57:33296) 2024-09-10T11:38:12.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.038+0000 7f5791c8a640 1 -- 172.21.15.57:0/414062262 learned_addr learned my addr 172.21.15.57:0/414062262 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.038+0000 7f579348d640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5784053730 0x7f57840de320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.038+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f578401d310 con 0x7f5784179f40 2024-09-10T11:38:12.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.039+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f578400ac60 con 0x7f5778005050 2024-09-10T11:38:12.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.039+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5784035fd0 con 0x7f5784053730 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.040+0000 7f5792c8c640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5784053730 0x7f57840de320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f5791c8a640 1 -- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5784053730 msgr2=0x7f57840de320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f5791c8a640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5784053730 0x7f57840de320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f5791c8a640 1 -- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 msgr2=0x7f57840e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f5791c8a640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 0x7f57840e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f5791c8a640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578417a3d0 con 0x7f5784179f40 2024-09-10T11:38:12.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.044+0000 7f5791c8a640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 0x7f57840ddde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f578800fa00 tx=0x7f578800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.041+0000 7f10bbce6640 1 -- 172.21.15.57:0/1917717309 wait complete. 2024-09-10T11:38:12.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f10bbce6640 1 Processor -- start 2024-09-10T11:38:12.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.043+0000 7f10bbce6640 1 -- start start 2024-09-10T11:38:12.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.044+0000 7f10bbce6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 0x7f10ac0da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.044+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788004230 con 0x7f5784179f40 2024-09-10T11:38:12.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f578800b960 con 0x7f5784179f40 2024-09-10T11:38:12.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57840df110 con 0x7f5784179f40 2024-09-10T11:38:12.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57840df6d0 con 0x7f5784179f40 2024-09-10T11:38:12.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f10b9a82640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 0x7f10ac0da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f10b9a82640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 0x7f10ac0da7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33306/0 (socket says 172.21.15.57:33306) 2024-09-10T11:38:12.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578800bdb0 con 0x7f5784179f40 2024-09-10T11:38:12.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.045+0000 7f10b9a82640 1 -- 172.21.15.57:0/3998444311 learned_addr learned my addr 172.21.15.57:0/3998444311 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.046+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57880035f0 con 0x7f5784179f40 2024-09-10T11:38:12.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.046+0000 7f10bbce6640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac04ded0 0x7f10ac04c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.046+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5788011940 con 0x7f5784179f40 2024-09-10T11:38:12.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.046+0000 7f10bbce6640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10ac04aed0 0x7f10ac04c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.047+0000 7f10b9281640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac04ded0 0x7f10ac04c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.047+0000 7f10ba283640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10ac04aed0 0x7f10ac04c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.048+0000 7fb636d1f640 1 -- 172.21.15.57:0/1513207845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb630159a60 con 0x7fb618003a30 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.047+0000 7f10bbce6640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac00ac60 con 0x7f10a0003dc0 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.047+0000 7f10bbce6640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac01d370 con 0x7f10ac04ded0 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.047+0000 7f10bbce6640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f10ac0e7890 con 0x7f10ac04aed0 2024-09-10T11:38:12.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.048+0000 7f10b9a82640 1 -- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10ac04aed0 msgr2=0x7f10ac04c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.048+0000 7f10b9a82640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10ac04aed0 0x7f10ac04c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.048+0000 7f10b9a82640 1 -- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac04ded0 msgr2=0x7f10ac04c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.048+0000 7f10b9a82640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac04ded0 0x7f10ac04c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.048+0000 7f10b9a82640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac178be0 con 0x7f10a0003dc0 2024-09-10T11:38:12.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.049+0000 7f10b9a82640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 0x7f10ac0da7f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10b4052540 tx=0x7f10b40b1910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.052+0000 7fb62d7fa640 1 -- 172.21.15.57:0/1513207845 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7fb62800c070 con 0x7fb618003a30 2024-09-10T11:38:12.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.052+0000 7f10ba283640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10ac04aed0 0x7f10ac04c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:12.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.052+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b40b7070 con 0x7f10a0003dc0 2024-09-10T11:38:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.052+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10b40b1b00 con 0x7f10a0003dc0 2024-09-10T11:38:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.052+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4051490 con 0x7f10a0003dc0 2024-09-10T11:38:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.053+0000 7f10bbce6640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac04b6c0 con 0x7f10a0003dc0 2024-09-10T11:38:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.053+0000 7f10bbce6640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac04bc80 con 0x7f10a0003dc0 2024-09-10T11:38:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.055+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac050d40 con 0x7f10a0003dc0 2024-09-10T11:38:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.057+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f10b40d3060 con 0x7f10a0003dc0 2024-09-10T11:38:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.058+0000 7fb616ffd640 1 -- 172.21.15.57:0/1513207845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618003a30 msgr2=0x7fb630159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.058+0000 7fb616ffd640 1 --2- 172.21.15.57:0/1513207845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618003a30 0x7fb630159520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb62802d750 tx=0x7fb628004bd0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.058+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578401cc60 con 0x7f5784179f40 2024-09-10T11:38:12.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.057+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f10b40d5740 con 0x7f10a0003dc0 2024-09-10T11:38:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 -- 172.21.15.57:0/1513207845 shutdown_connections 2024-09-10T11:38:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 --2- 172.21.15.57:0/1513207845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63014c050 0x7fb63014c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 --2- 172.21.15.57:0/1513207845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6300b2090 0x7fb630157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 --2- 172.21.15.57:0/1513207845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb618003a30 0x7fb630159520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 -- 172.21.15.57:0/1513207845 >> 172.21.15.57:0/1513207845 conn(0x7fb6300d0a60 msgr2=0x7fb63015db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fac527fc640 1 -- 172.21.15.57:0/525375836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fac60005920 con 0x7fac60034b90 2024-09-10T11:38:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 -- 172.21.15.57:0/1513207845 shutdown_connections 2024-09-10T11:38:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f10ac050d40 con 0x7f10a0003dc0 2024-09-10T11:38:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.062+0000 7fb616ffd640 1 -- 172.21.15.57:0/1513207845 wait complete. 2024-09-10T11:38:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.066+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5788011440 con 0x7f5784179f40 2024-09-10T11:38:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.075+0000 7fac64ff9640 1 -- 172.21.15.57:0/525375836 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7fac540158b0 con 0x7fac60034b90 2024-09-10T11:38:12.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.078+0000 7fac527fc640 1 -- 172.21.15.57:0/525375836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac60034b90 msgr2=0x7fac600490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.078+0000 7fac527fc640 1 --2- 172.21.15.57:0/525375836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac60034b90 0x7fac600490d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac5400b510 tx=0x7fac5400b9d0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.081+0000 7fac527fc640 1 -- 172.21.15.57:0/525375836 shutdown_connections 2024-09-10T11:38:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.081+0000 7fac527fc640 1 --2- 172.21.15.57:0/525375836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac60054850 0x7fac600331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.081+0000 7fac527fc640 1 --2- 172.21.15.57:0/525375836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac60034b90 0x7fac600490d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.081+0000 7fac527fc640 1 --2- 172.21.15.57:0/525375836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac60034640 0x7fac6004bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.081+0000 7fac527fc640 1 -- 172.21.15.57:0/525375836 >> 172.21.15.57:0/525375836 conn(0x7fac6001e880 msgr2=0x7fac6000aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.088+0000 7fac527fc640 1 -- 172.21.15.57:0/525375836 shutdown_connections 2024-09-10T11:38:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.096+0000 7fac527fc640 1 -- 172.21.15.57:0/525375836 wait complete. 2024-09-10T11:38:12.099 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.104+0000 7f0388980640 1 -- 172.21.15.57:0/123842272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c04eb20 msgr2=0x7f037c036110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.104+0000 7f0388980640 1 --2- 172.21.15.57:0/123842272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c04eb20 0x7f037c036110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f037c035e00 tx=0x7f037002a380 comp rx=0 tx=0).stop 2024-09-10T11:38:12.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.105+0000 7f0388980640 1 -- 172.21.15.57:0/123842272 shutdown_connections 2024-09-10T11:38:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.105+0000 7f0388980640 1 --2- 172.21.15.57:0/123842272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c04eb20 0x7f037c036110 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f037c035e00 tx=0x7f037002a380 comp rx=0 tx=0).stop 2024-09-10T11:38:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.105+0000 7f0388980640 1 -- 172.21.15.57:0/123842272 >> 172.21.15.57:0/123842272 conn(0x7f037c01d770 msgr2=0x7f037c054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.105+0000 7faa01afc640 1 -- 172.21.15.57:0/3743461773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 msgr2=0x7fa9ec004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.105+0000 7faa01afc640 1 --2- 172.21.15.57:0/3743461773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 0x7fa9ec004050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006ee0 tx=0x7fa9ec005830 comp rx=0 tx=0).stop 2024-09-10T11:38:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.106+0000 7f0388980640 1 -- 172.21.15.57:0/123842272 shutdown_connections 2024-09-10T11:38:12.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.110+0000 7f0388980640 1 -- 172.21.15.57:0/123842272 wait complete. 2024-09-10T11:38:12.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.110+0000 7faa01afc640 1 -- 172.21.15.57:0/3743461773 shutdown_connections 2024-09-10T11:38:12.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.110+0000 7faa01afc640 1 --2- 172.21.15.57:0/3743461773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 0x7fa9ec004050 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.110+0000 7faa01afc640 1 -- 172.21.15.57:0/3743461773 >> 172.21.15.57:0/3743461773 conn(0x7fa9f401d760 msgr2=0x7fa9f4054550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.112+0000 7f0388980640 1 Processor -- start 2024-09-10T11:38:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.116+0000 7f0388980640 1 -- start start 2024-09-10T11:38:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f0388980640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f037c0e69b0 0x7f037c0db500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.118+0000 7faa01afc640 1 -- 172.21.15.57:0/3743461773 shutdown_connections 2024-09-10T11:38:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.118+0000 7faa01afc640 1 -- 172.21.15.57:0/3743461773 wait complete. 2024-09-10T11:38:12.121 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f0388980640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c0e6d90 0x7f037c053df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f0388980640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f037c17e710 0x7f037c0e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f0388980640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f037c055290 con 0x7f037c0e69b0 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f0388980640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f037c0e48f0 con 0x7f037c0e6d90 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f0388980640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f037c053960 con 0x7f037c17e710 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f03837fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f037c0e69b0 0x7f037c0db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f03837fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f037c0e69b0 0x7f037c0db500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33336/0 (socket says 172.21.15.57:33336) 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.117+0000 7f03837fe640 1 -- 172.21.15.57:0/2271819380 learned_addr learned my addr 172.21.15.57:0/2271819380 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.118+0000 7f0383fff640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f037c17e710 0x7f037c0e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.118+0000 7f0382ffd640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c0e6d90 0x7f037c053df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.119+0000 7f0383fff640 1 -- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c0e6d90 msgr2=0x7f037c053df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.119+0000 7f0383fff640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c0e6d90 0x7f037c053df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.119+0000 7f0383fff640 1 -- 172.21.15.57:0/2271819380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f037c0e69b0 msgr2=0x7f037c0db500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.119+0000 7f0383fff640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f037c0e69b0 0x7f037c0db500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.119+0000 7f0383fff640 1 -- 172.21.15.57:0/2271819380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c0530a0 con 0x7f037c17e710 2024-09-10T11:38:12.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.119+0000 7f0383fff640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f037c17e710 0x7f037c0e5b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f038406b210 tx=0x7f038406a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.120+0000 7faa01afc640 1 Processor -- start 2024-09-10T11:38:12.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.123+0000 7faa01afc640 1 -- start start 2024-09-10T11:38:12.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7faa01afc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 0x7fa9f40da960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7faa01afc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 0x7fa9f417dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7faa01afc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f40dbd40 0x7fa9f417e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384093600 con 0x7f037c17e710 2024-09-10T11:38:12.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0384093890 con 0x7f037c17e710 2024-09-10T11:38:12.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384093ce0 con 0x7f037c17e710 2024-09-10T11:38:12.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7faa01afc640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f40071d0 con 0x7fa9ec003c30 2024-09-10T11:38:12.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7faa01afc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4007050 con 0x7fa9f40dbd40 2024-09-10T11:38:12.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.125+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037c053310 con 0x7f037c17e710 2024-09-10T11:38:12.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.124+0000 7faa01afc640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f4007350 con 0x7fa9f40db8e0 2024-09-10T11:38:12.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.125+0000 7fa9fbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 0x7fa9f417dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.125+0000 7fa9fbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 0x7fa9f417dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:33808/0 (socket says 172.21.15.57:33808) 2024-09-10T11:38:12.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.125+0000 7fa9fbfff640 1 -- 172.21.15.57:0/2789219011 learned_addr learned my addr 172.21.15.57:0/2789219011 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.125+0000 7faa012fb640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f40dbd40 0x7fa9f417e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.126+0000 7fa9fbfff640 1 -- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f40dbd40 msgr2=0x7fa9f417e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.126+0000 7fa9fbfff640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f40dbd40 0x7fa9f417e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.126+0000 7fa9fbfff640 1 -- 172.21.15.57:0/2789219011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 msgr2=0x7fa9f40da960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.126+0000 7fa9fbfff640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 0x7fa9f40da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.126+0000 7fa9fbfff640 1 -- 172.21.15.57:0/2789219011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f417e6e0 con 0x7fa9f40db8e0 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.125+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f037c17ebc0 con 0x7f037c17e710 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.127+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0384073360 con 0x7f037c17e710 2024-09-10T11:38:12.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.127+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f038409c730 con 0x7f037c17e710 2024-09-10T11:38:12.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.130+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037c006e50 con 0x7f037c17e710 2024-09-10T11:38:12.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.132+0000 7fa9fbfff640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 0x7fa9f417dba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc066640 tx=0x7fa9fc06a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.133+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc094620 con 0x7fa9f40db8e0 2024-09-10T11:38:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.134+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9fc08f030 con 0x7fa9f40db8e0 2024-09-10T11:38:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.134+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc094ac0 con 0x7fa9f40db8e0 2024-09-10T11:38:12.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.134+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f417e9c0 con 0x7fa9f40db8e0 2024-09-10T11:38:12.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.134+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f40da160 con 0x7fa9f40db8e0 2024-09-10T11:38:12.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.136+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f4036100 con 0x7fa9f40db8e0 2024-09-10T11:38:12.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.136+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9fc093760 con 0x7fa9f40db8e0 2024-09-10T11:38:12.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.136+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa9fc09d890 con 0x7fa9f40db8e0 2024-09-10T11:38:12.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.134+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f038408f030 con 0x7f037c17e710 2024-09-10T11:38:12.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.141+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa9fc093a50 con 0x7fa9f40db8e0 2024-09-10T11:38:12.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.157+0000 7fd105423640 1 -- 172.21.15.57:0/1243985670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd0e0005580 con 0x7fd10006cb40 2024-09-10T11:38:12.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.161+0000 7f1a2c685640 1 -- 172.21.15.57:0/2922566102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 msgr2=0x7f1a240d1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.161+0000 7f1a2c685640 1 --2- 172.21.15.57:0/2922566102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a240d1890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a20005fd0 tx=0x7f1a2002a510 comp rx=0 tx=0).stop 2024-09-10T11:38:12.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.161+0000 7f1a2c685640 1 -- 172.21.15.57:0/2922566102 shutdown_connections 2024-09-10T11:38:12.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.161+0000 7f1a2c685640 1 --2- 172.21.15.57:0/2922566102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a240d1890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.161+0000 7f1a2c685640 1 -- 172.21.15.57:0/2922566102 >> 172.21.15.57:0/2922566102 conn(0x7f1a240d3cc0 msgr2=0x7f1a240d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.161+0000 7fd0fcff9640 1 -- 172.21.15.57:0/1243985670 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7fd0f8021680 con 0x7fd10006cb40 2024-09-10T11:38:12.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.162+0000 7f1a2c685640 1 -- 172.21.15.57:0/2922566102 shutdown_connections 2024-09-10T11:38:12.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.162+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7e30005850 con 0x7f7e500cfc60 2024-09-10T11:38:12.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.162+0000 7f1a2c685640 1 -- 172.21.15.57:0/2922566102 wait complete. 2024-09-10T11:38:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 -- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 msgr2=0x7fd100160b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 0x7fd100160b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800ed80 tx=0x7fd0f800c6e0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 -- 172.21.15.57:0/1243985670 shutdown_connections 2024-09-10T11:38:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10006f450 0x7fd1001603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd10006cf20 0x7fd100152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 --2- 172.21.15.57:0/1243985670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd10006cb40 0x7fd100160b70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.164+0000 7fd0e67fc640 1 -- 172.21.15.57:0/1243985670 >> 172.21.15.57:0/1243985670 conn(0x7fd1000cf9a0 msgr2=0x7fd100072120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.165+0000 7fd0e67fc640 1 -- 172.21.15.57:0/1243985670 shutdown_connections 2024-09-10T11:38:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.165+0000 7fd0e67fc640 1 -- 172.21.15.57:0/1243985670 wait complete. 2024-09-10T11:38:12.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.165+0000 7f1a2c685640 1 Processor -- start 2024-09-10T11:38:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f6398a16640 1 -- 172.21.15.57:0/2874950533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 msgr2=0x7f637c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f6398a16640 1 --2- 172.21.15.57:0/2874950533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 0x7f637c004c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f638800c310 tx=0x7f637c005830 comp rx=0 tx=0).stop 2024-09-10T11:38:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f7e37fff640 1 -- 172.21.15.57:0/998920168 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f7e480188f0 con 0x7f7e500cfc60 2024-09-10T11:38:12.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.166+0000 7f1a2c685640 1 -- start start 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a2c685640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a240cfa10 0x7f1a2414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a2c685640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 0x7f1a2414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a2c685640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a2414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a29c20640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 0x7f1a2414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a29c20640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 0x7f1a2414f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:33834/0 (socket says 172.21.15.57:33834) 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a29c20640 1 -- 172.21.15.57:0/2347521250 learned_addr learned my addr 172.21.15.57:0/2347521250 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.167+0000 7f1a2a421640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a240cfa10 0x7f1a2414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1a240b3380 con 0x7f1a240cfa10 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a240d00b0 con 0x7f1a240d2280 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1a240b3500 con 0x7f1a240d10f0 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a2ac22640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a2414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a29c20640 1 -- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 msgr2=0x7f1a2414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a29c20640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a2414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a29c20640 1 -- 172.21.15.57:0/2347521250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a240cfa10 msgr2=0x7f1a2414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a29c20640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a240cfa10 0x7f1a2414ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.168+0000 7f1a29c20640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a240ca420 con 0x7f1a240d10f0 2024-09-10T11:38:12.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a2ac22640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a2414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a29c20640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 0x7f1a2414f470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c450 tx=0x7f1a1400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f6398a16640 1 -- 172.21.15.57:0/2874950533 shutdown_connections 2024-09-10T11:38:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f6398a16640 1 --2- 172.21.15.57:0/2874950533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 0x7f637c004c80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f6398a16640 1 -- 172.21.15.57:0/2874950533 >> 172.21.15.57:0/2874950533 conn(0x7f63940b1e40 msgr2=0x7f63940b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14016020 con 0x7f1a240d10f0 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 msgr2=0x7f7e500ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 0x7f7e500ceba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800ebc0 tx=0x7f7e4800c6a0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 shutdown_connections 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e50161bf0 0x7f7e5015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e500cfc60 0x7f7e500ceba0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 --2- 172.21.15.57:0/998920168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e500cf880 0x7f7e501497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 >> 172.21.15.57:0/998920168 conn(0x7f7e5006c8d0 msgr2=0x7f7e5014d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a241fd560 con 0x7f1a240d10f0 2024-09-10T11:38:12.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2414f200 con 0x7f1a240d10f0 2024-09-10T11:38:12.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a140053c0 con 0x7f1a240d10f0 2024-09-10T11:38:12.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.169+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14007280 con 0x7f1a240d10f0 2024-09-10T11:38:12.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.170+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 shutdown_connections 2024-09-10T11:38:12.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.171+0000 7f7e55907640 1 -- 172.21.15.57:0/998920168 wait complete. 2024-09-10T11:38:12.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.171+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a14006b60 con 0x7f1a240d10f0 2024-09-10T11:38:12.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.171+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c005290 con 0x7f1a240d10f0 2024-09-10T11:38:12.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.171+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a140035f0 con 0x7f1a240d10f0 2024-09-10T11:38:12.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.171+0000 7f6398a16640 1 -- 172.21.15.57:0/2874950533 shutdown_connections 2024-09-10T11:38:12.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.171+0000 7f6398a16640 1 -- 172.21.15.57:0/2874950533 wait complete. 2024-09-10T11:38:12.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.174+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1a14020020 con 0x7f1a240d10f0 2024-09-10T11:38:12.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.174+0000 7f6398a16640 1 Processor -- start 2024-09-10T11:38:12.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.178+0000 7f6398a16640 1 -- start start 2024-09-10T11:38:12.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.179+0000 7f6398a16640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 0x7f639414b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.179+0000 7f6398a16640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 0x7f6394201190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.179+0000 7f6398a16640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63942016d0 0x7f6394201b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.184+0000 7f6398a16640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f63940b2960 con 0x7f63942016d0 2024-09-10T11:38:12.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.184+0000 7f6398a16640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63940b1930 con 0x7f6394159130 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.184+0000 7f6398a16640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f63940b2ae0 con 0x7f637c004800 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.184+0000 7f6391d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 0x7f6394201190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 0x7f6394201190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:42590/0 (socket says 172.21.15.57:42590) 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 -- 172.21.15.57:0/1212795113 learned_addr learned my addr 172.21.15.57:0/1212795113 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f639259c640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 0x7f639414b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 -- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 msgr2=0x7f639414b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 0x7f639414b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 -- 172.21.15.57:0/1212795113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63942016d0 msgr2=0x7f6394201b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:12.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63942016d0 0x7f6394201b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.185+0000 7f6391d9b640 1 -- 172.21.15.57:0/1212795113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639414b570 con 0x7f6394159130 2024-09-10T11:38:12.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.187+0000 7f6391d9b640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 0x7f6394201190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f638802b1d0 tx=0x7f6388001720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.190 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.189+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388003a00 con 0x7f6394159130 2024-09-10T11:38:12.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.189+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6388003ba0 con 0x7f6394159130 2024-09-10T11:38:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.190+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638802b520 con 0x7f6394159130 2024-09-10T11:38:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.190+0000 7f6398a16640 1 -- 172.21.15.57:0/1212795113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639414b7f0 con 0x7f6394159130 2024-09-10T11:38:12.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.191+0000 7f6398a16640 1 -- 172.21.15.57:0/1212795113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639414bdb0 con 0x7f6394159130 2024-09-10T11:38:12.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.196+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639414c470 con 0x7f6394159130 2024-09-10T11:38:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.198+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f638803c070 con 0x7f6394159130 2024-09-10T11:38:12.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.198+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6388034930 con 0x7f6394159130 2024-09-10T11:38:12.201 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.200+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f639414c470 con 0x7f6394159130 2024-09-10T11:38:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.219+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f10ac01d130 con 0x7f10a0003dc0 2024-09-10T11:38:12.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.224+0000 7f10aa7fc640 1 -- 172.21.15.57:0/3998444311 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7f10b4090070 con 0x7f10a0003dc0 2024-09-10T11:38:12.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.226+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 msgr2=0x7f10ac0da7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.226+0000 7f1097fff640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 0x7f10ac0da7f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10b4052540 tx=0x7f10b40b1910 comp rx=0 tx=0).stop 2024-09-10T11:38:12.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fe0e0005580 con 0x7fe0f80351a0 2024-09-10T11:38:12.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 shutdown_connections 2024-09-10T11:38:12.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10ac04aed0 0x7f10ac04c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10ac04ded0 0x7f10ac04c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 --2- 172.21.15.57:0/3998444311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10a0003dc0 0x7f10ac0da7f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 >> 172.21.15.57:0/3998444311 conn(0x7f10ac054550 msgr2=0x7f10ac052e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 shutdown_connections 2024-09-10T11:38:12.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.227+0000 7f1097fff640 1 -- 172.21.15.57:0/3998444311 wait complete. 2024-09-10T11:38:12.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.231+0000 7fe0fcff9640 1 -- 172.21.15.57:0/780154853 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7fe1000a6660 con 0x7fe0f80351a0 2024-09-10T11:38:12.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f80351a0 msgr2=0x7fe0f80d58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f80351a0 0x7fe0f80d58b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1000663d0 tx=0x7fe10006c1b0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 shutdown_connections 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0f80e31d0 0x7fe0f80d8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f80e2df0 0x7fe0f80320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 --2- 172.21.15.57:0/780154853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0f80351a0 0x7fe0f80d58b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.232+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 >> 172.21.15.57:0/780154853 conn(0x7fe0f801d760 msgr2=0x7fe0f8039dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.233+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 shutdown_connections 2024-09-10T11:38:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.233+0000 7fe10545d640 1 -- 172.21.15.57:0/780154853 wait complete. 2024-09-10T11:38:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.235+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f57840359b0 con 0x7f5784179f40 2024-09-10T11:38:12.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.243+0000 7f5782ffd640 1 -- 172.21.15.57:0/414062262 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f5788011b90 con 0x7f5784179f40 2024-09-10T11:38:12.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 msgr2=0x7f57840ddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 0x7f57840ddde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f578800fa00 tx=0x7f578800fec0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 shutdown_connections 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5784053730 0x7f57840de320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5784179f40 0x7f57840ddde0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 --2- 172.21.15.57:0/414062262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5778005050 0x7f57840e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 >> 172.21.15.57:0/414062262 conn(0x7f5784054550 msgr2=0x7f57840051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.246+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 shutdown_connections 2024-09-10T11:38:12.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.247+0000 7f579348d640 1 -- 172.21.15.57:0/414062262 wait complete. 2024-09-10T11:38:12.253 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.263 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.279+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f037c053ae0 con 0x7f037c17e710 2024-09-10T11:38:12.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.283+0000 7f036ffff640 1 -- 172.21.15.57:0/2271819380 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f038406a140 con 0x7f037c17e710 2024-09-10T11:38:12.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.284+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f1a0c005580 con 0x7f1a240d10f0 2024-09-10T11:38:12.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.284+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f037c17e710 msgr2=0x7f037c0e5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.284+0000 7f0388980640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f037c17e710 0x7f037c0e5b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f038406b210 tx=0x7f038406a0d0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.284+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 shutdown_connections 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.285+0000 7f0388980640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f037c17e710 0x7f037c0e5b00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.285+0000 7f0388980640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f037c0e6d90 0x7f037c053df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.285+0000 7f0388980640 1 --2- 172.21.15.57:0/2271819380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f037c0e69b0 0x7f037c0db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.285+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 >> 172.21.15.57:0/2271819380 conn(0x7f037c01d770 msgr2=0x7f037c0e4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.285+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 shutdown_connections 2024-09-10T11:38:12.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.285+0000 7f0388980640 1 -- 172.21.15.57:0/2271819380 wait complete. 2024-09-10T11:38:12.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.287+0000 7f1a1affd640 1 -- 172.21.15.57:0/2347521250 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) ==== 125+0+0 (secure 0 0 0) 0x7f1a14007420 con 0x7f1a240d10f0 2024-09-10T11:38:12.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 msgr2=0x7f1a2414f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 0x7f1a2414f470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c450 tx=0x7f1a1400c910 comp rx=0 tx=0).stop 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 shutdown_connections 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a240d2280 0x7f1a2414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a240d10f0 0x7f1a2414f470 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 --2- 172.21.15.57:0/2347521250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a240cfa10 0x7f1a2414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 >> 172.21.15.57:0/2347521250 conn(0x7f1a240d3cc0 msgr2=0x7f1a2406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 shutdown_connections 2024-09-10T11:38:12.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.288+0000 7f1a2c685640 1 -- 172.21.15.57:0/2347521250 wait complete. 2024-09-10T11:38:12.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.290+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa9f40500c0 con 0x7fa9f40db8e0 2024-09-10T11:38:12.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.294+0000 7fa9f97fa640 1 -- 172.21.15.57:0/2789219011 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fa9fc093a50 con 0x7fa9f40db8e0 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.295+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 msgr2=0x7fa9f417dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.295+0000 7faa01afc640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 0x7fa9f417dba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc066640 tx=0x7fa9fc06a0d0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 shutdown_connections 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f40dbd40 0x7fa9f417e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f40db8e0 0x7fa9f417dba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 --2- 172.21.15.57:0/2789219011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9ec003c30 0x7fa9f40da960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 >> 172.21.15.57:0/2789219011 conn(0x7fa9f401d760 msgr2=0x7fa9f404eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 shutdown_connections 2024-09-10T11:38:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.296+0000 7faa01afc640 1 -- 172.21.15.57:0/2789219011 wait complete. 2024-09-10T11:38:12.309 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.310 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.310 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi057') 2024-09-10T11:38:12.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.313+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f63940cae00 con 0x7f6394159130 2024-09-10T11:38:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.317+0000 7f6382ffd640 1 -- 172.21.15.57:0/1212795113 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f638804c020 con 0x7f6394159130 2024-09-10T11:38:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.317+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 msgr2=0x7f6394201190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.317+0000 7f6380ff9640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 0x7f6394201190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f638802b1d0 tx=0x7f6388001720 comp rx=0 tx=0).stop 2024-09-10T11:38:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 shutdown_connections 2024-09-10T11:38:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63942016d0 0x7f6394201b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6394159130 0x7f6394201190 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 --2- 172.21.15.57:0/1212795113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f637c004800 0x7f639414b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 >> 172.21.15.57:0/1212795113 conn(0x7f63940b1e40 msgr2=0x7f639406ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 shutdown_connections 2024-09-10T11:38:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.318+0000 7f6380ff9640 1 -- 172.21.15.57:0/1212795113 wait complete. 2024-09-10T11:38:12.330 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T11:38:12.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.473+0000 7fc35a40f640 1 -- 172.21.15.57:0/2499195954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 msgr2=0x7fc354073ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.473+0000 7fc35a40f640 1 --2- 172.21.15.57:0/2499195954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc354073ff0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc34c005fd0 tx=0x7fc34c02a8b0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.474+0000 7fc35a40f640 1 -- 172.21.15.57:0/2499195954 shutdown_connections 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.474+0000 7fc35a40f640 1 --2- 172.21.15.57:0/2499195954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc354073ff0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.474+0000 7fc35a40f640 1 -- 172.21.15.57:0/2499195954 >> 172.21.15.57:0/2499195954 conn(0x7fc3540cd430 msgr2=0x7fc3540cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.474+0000 7fc35a40f640 1 -- 172.21.15.57:0/2499195954 shutdown_connections 2024-09-10T11:38:12.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.474+0000 7fc35a40f640 1 -- 172.21.15.57:0/2499195954 wait complete. 2024-09-10T11:38:12.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.475+0000 7fc35a40f640 1 Processor -- start 2024-09-10T11:38:12.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.475+0000 7fc35a40f640 1 -- start start 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc35a40f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc354073860 0x7fc3540ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc35a40f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 0x7fc3540c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc35a40f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc3540c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc35a40f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540cf8b0 con 0x7fc35415a870 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc35a40f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540cf730 con 0x7fc35415ac50 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc35a40f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3540cfa30 con 0x7fc354073860 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 0x7fc3540c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 0x7fc3540c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33368/0 (socket says 172.21.15.57:33368) 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 -- 172.21.15.57:0/1014082435 learned_addr learned my addr 172.21.15.57:0/1014082435 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3589ac640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc3540c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc353fff640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc354073860 0x7fc3540ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 -- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc354073860 msgr2=0x7fc3540ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc354073860 0x7fc3540ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 -- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 msgr2=0x7fc3540c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc3540c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 -- 172.21.15.57:0/1014082435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3540c5620 con 0x7fc35415a870 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3589ac640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc3540c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:12.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.476+0000 7fc3537fe640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 0x7fc3540c4eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc34800c400 tx=0x7fc34800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348011790 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc348017070 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3540c5dc0 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348011d00 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3540c6380 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc34801c460 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.477+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc3480128b0 con 0x7fc35415a870 2024-09-10T11:38:12.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.478+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3540cff80 con 0x7fc35415a870 2024-09-10T11:38:12.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.481+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc348012b00 con 0x7fc35415a870 2024-09-10T11:38:12.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.547+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc3540c6550 con 0x7fc35415a870 2024-09-10T11:38:12.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.551+0000 7fc350ff9640 1 -- 172.21.15.57:0/1014082435 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fc348012ce0 con 0x7fc35415a870 2024-09-10T11:38:12.553 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 msgr2=0x7fc3540c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 0x7fc3540c4eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc34800c400 tx=0x7fc34800c8c0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 shutdown_connections 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415ac50 0x7fc3540c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35415a870 0x7fc3540c4eb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 --2- 172.21.15.57:0/1014082435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc354073860 0x7fc3540ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 >> 172.21.15.57:0/1014082435 conn(0x7fc3540cd430 msgr2=0x7fc3540755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 shutdown_connections 2024-09-10T11:38:12.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:12.552+0000 7fc35a40f640 1 -- 172.21.15.57:0/1014082435 wait complete. 2024-09-10T11:38:12.564 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T11:38:12.564 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T11:38:12.565 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:12.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T11:38:12.590 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:12.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T11:38:12.657 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:12.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T11:38:12.723 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-09-10T11:38:12.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T11:38:12.788 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:12.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T11:38:12.813 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:12.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T11:38:12.878 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:12.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T11:38:12.943 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T11:38:12.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T11:38:13.008 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 317ac81b-9740-4cd4-bfa8-924e88ee3d5a 0 2024-09-10T11:38:13.092 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:13.091+0000 7f56497ef040 -1 mgr[py] Module not found: 'volumes' 2024-09-10T11:38:13.093 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:13.091+0000 7f56497ef040 -1 mgr[py] Traceback (most recent call last): 2024-09-10T11:38:13.093 INFO:tasks.ceph.mgr.x.smithi154.stderr: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-10T11:38:13.093 INFO:tasks.ceph.mgr.x.smithi154.stderr: from .module import Module 2024-09-10T11:38:13.093 INFO:tasks.ceph.mgr.x.smithi154.stderr: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-10T11:38:13.093 INFO:tasks.ceph.mgr.x.smithi154.stderr: from .fs.volume import VolumeClient 2024-09-10T11:38:13.093 INFO:tasks.ceph.mgr.x.smithi154.stderr: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-10T11:38:13.094 INFO:tasks.ceph.mgr.x.smithi154.stderr: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-10T11:38:13.094 INFO:tasks.ceph.mgr.x.smithi154.stderr:ModuleNotFoundError: No module named 'ceph.fs' 2024-09-10T11:38:13.094 INFO:tasks.ceph.mgr.x.smithi154.stderr: 2024-09-10T11:38:13.094 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:13.092+0000 7f56497ef040 -1 mgr[py] Class not found in module 'volumes' 2024-09-10T11:38:13.094 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:13.092+0000 7f56497ef040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 -- 172.21.15.154:0/3966051237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86006cfe0 msgr2=0x7fb86015c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 --2- 172.21.15.154:0/3966051237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86006cfe0 0x7fb86015c980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009860 tx=0x7fb85c02a5a0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 -- 172.21.15.154:0/3966051237 shutdown_connections 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 --2- 172.21.15.154:0/3966051237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86006cfe0 0x7fb86015c980 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 -- 172.21.15.154:0/3966051237 >> 172.21.15.154:0/3966051237 conn(0x7fb8600cd430 msgr2=0x7fb8600cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 -- 172.21.15.154:0/3966051237 shutdown_connections 2024-09-10T11:38:13.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.149+0000 7fb868295640 1 -- 172.21.15.154:0/3966051237 wait complete. 2024-09-10T11:38:13.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.150+0000 7fb868295640 1 Processor -- start 2024-09-10T11:38:13.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.150+0000 7fb868295640 1 -- start start 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb868295640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86006cfe0 0x7fb8601e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb868295640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8600afbd0 0x7fb8600cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb868295640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 0x7fb8600c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb868295640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb8600739e0 con 0x7fb8600afbd0 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb868295640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb860073860 con 0x7fb86006cfe0 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb868295640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb860073b60 con 0x7fb86015bab0 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb866832640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 0x7fb8600c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb866031640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86006cfe0 0x7fb8601e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb866832640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 0x7fb8600c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49894/0 (socket says 172.21.15.154:49894) 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb866832640 1 -- 172.21.15.154:0/1520700215 learned_addr learned my addr 172.21.15.154:0/1520700215 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.151+0000 7fb865830640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8600afbd0 0x7fb8600cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866031640 1 -- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 msgr2=0x7fb8600c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866031640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 0x7fb8600c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866031640 1 -- 172.21.15.154:0/1520700215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8600afbd0 msgr2=0x7fb8600cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866031640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8600afbd0 0x7fb8600cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866031640 1 -- 172.21.15.154:0/1520700215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8601e50a0 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866832640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 0x7fb8600c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb866031640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86006cfe0 0x7fb8601e4b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb85000c3c0 tx=0x7fb85000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850011790 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb850017070 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601e5340 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850011d20 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601e5900 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb85001c460 con 0x7fb86006cfe0 2024-09-10T11:38:13.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.152+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb8500127c0 con 0x7fb86006cfe0 2024-09-10T11:38:13.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.153+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb86015c980 con 0x7fb86006cfe0 2024-09-10T11:38:13.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.155+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb850012a10 con 0x7fb86006cfe0 2024-09-10T11:38:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.226+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "317ac81b-9740-4cd4-bfa8-924e88ee3d5a", "id": 0} v 0) -- 0x7fb86015b480 con 0x7fb86006cfe0 2024-09-10T11:38:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.229+0000 7fb856ffd640 1 -- 172.21.15.154:0/1520700215 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "317ac81b-9740-4cd4-bfa8-924e88ee3d5a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb850012bf0 con 0x7fb86006cfe0 2024-09-10T11:38:13.230 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86006cfe0 msgr2=0x7fb8601e4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86006cfe0 0x7fb8601e4b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb85000c3c0 tx=0x7fb85000c880 comp rx=0 tx=0).stop 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 shutdown_connections 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86015bab0 0x7fb8600c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8600afbd0 0x7fb8600cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 --2- 172.21.15.154:0/1520700215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86006cfe0 0x7fb8601e4b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 >> 172.21.15.154:0/1520700215 conn(0x7fb8600cd430 msgr2=0x7fb8600b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 shutdown_connections 2024-09-10T11:38:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.230+0000 7fb868295640 1 -- 172.21.15.154:0/1520700215 wait complete. 2024-09-10T11:38:13.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 6ddc1847-fef4-448a-8222-528cee0fe3ac 1 2024-09-10T11:38:13.301 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-09-10T11:38:13.299+0000 7fd1ab62e040 -1 mgr[py] Module not found: 'volumes' 2024-09-10T11:38:13.301 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-09-10T11:38:13.299+0000 7fd1ab62e040 -1 mgr[py] Traceback (most recent call last): 2024-09-10T11:38:13.301 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr: from .module import Module 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr: from .fs.volume import VolumeClient 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr:ModuleNotFoundError: No module named 'ceph.fs' 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr: 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-09-10T11:38:13.300+0000 7fd1ab62e040 -1 mgr[py] Class not found in module 'volumes' 2024-09-10T11:38:13.302 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-09-10T11:38:13.300+0000 7fd1ab62e040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-10T11:38:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 -- 172.21.15.154:0/872654311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 msgr2=0x7f84e00ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 --2- 172.21.15.154:0/872654311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00ce430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009860 tx=0x7f84d002a480 comp rx=0 tx=0).stop 2024-09-10T11:38:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 -- 172.21.15.154:0/872654311 shutdown_connections 2024-09-10T11:38:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 --2- 172.21.15.154:0/872654311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00ce430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 -- 172.21.15.154:0/872654311 >> 172.21.15.154:0/872654311 conn(0x7f84e00d1b40 msgr2=0x7f84e00d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 -- 172.21.15.154:0/872654311 shutdown_connections 2024-09-10T11:38:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.343+0000 7f84e5d4c640 1 -- 172.21.15.154:0/872654311 wait complete. 2024-09-10T11:38:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.344+0000 7f84e5d4c640 1 Processor -- start 2024-09-10T11:38:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.344+0000 7f84e5d4c640 1 -- start start 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84e5d4c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84e00b0c40 0x7f84e00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84e5d4c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e00b2230 0x7f84e00afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84e5d4c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84e5d4c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00d2660 con 0x7f84e00b0c40 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84e5d4c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00ce110 con 0x7f84e00b2230 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84e5d4c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00d27e0 con 0x7f84e015f1b0 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84deffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e00b2230 0x7f84e00afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49924/0 (socket says 172.21.15.154:49924) 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 -- 172.21.15.154:0/3304553154 learned_addr learned my addr 172.21.15.154:0/3304553154 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84df7fe640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84e00b0c40 0x7f84e00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 -- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e00b2230 msgr2=0x7f84e00afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e00b2230 0x7f84e00afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 -- 172.21.15.154:0/3304553154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84e00b0c40 msgr2=0x7f84e00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84e00b0c40 0x7f84e00c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 -- 172.21.15.154:0/3304553154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e015b950 con 0x7f84e015f1b0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.345+0000 7f84dffff640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00c5670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c7a0 tx=0x7f84d800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003b70 con 0x7f84e015f1b0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84d8003d10 con 0x7f84e015f1b0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e00b4250 con 0x7f84e015f1b0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d800aa50 con 0x7f84e015f1b0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e00b3f70 con 0x7f84e015f1b0 2024-09-10T11:38:13.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84d800abf0 con 0x7f84e015f1b0 2024-09-10T11:38:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.346+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f84d8012630 con 0x7f84e015f1b0 2024-09-10T11:38:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.347+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e00ceb30 con 0x7f84e015f1b0 2024-09-10T11:38:13.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.349+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f84d80050d0 con 0x7f84e015f1b0 2024-09-10T11:38:13.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.418+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6ddc1847-fef4-448a-8222-528cee0fe3ac", "id": 1} v 0) -- 0x7f84e00ce5a0 con 0x7f84e015f1b0 2024-09-10T11:38:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.421+0000 7f84c7fff640 1 -- 172.21.15.154:0/3304553154 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ddc1847-fef4-448a-8222-528cee0fe3ac", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f84d80052b0 con 0x7f84e015f1b0 2024-09-10T11:38:13.423 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 msgr2=0x7f84e00c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00c5670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c7a0 tx=0x7f84d800cc60 comp rx=0 tx=0).stop 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 shutdown_connections 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84e015f1b0 0x7f84e00c5670 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84e00b2230 0x7f84e00afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 --2- 172.21.15.154:0/3304553154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84e00b0c40 0x7f84e00c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 >> 172.21.15.154:0/3304553154 conn(0x7f84e00d1b40 msgr2=0x7f84e00b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.422+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 shutdown_connections 2024-09-10T11:38:13.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.423+0000 7f84e5d4c640 1 -- 172.21.15.154:0/3304553154 wait complete. 2024-09-10T11:38:13.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new dd781c85-161f-4605-aa0c-bee88f13f236 2 2024-09-10T11:38:13.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.535+0000 7f4a82be2640 1 -- 172.21.15.154:0/3591059878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 msgr2=0x7f4a7c0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.535+0000 7f4a82be2640 1 --2- 172.21.15.154:0/3591059878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c0cf780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009830 tx=0x7f4a7002a4a0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.536+0000 7f4a82be2640 1 -- 172.21.15.154:0/3591059878 shutdown_connections 2024-09-10T11:38:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.536+0000 7f4a82be2640 1 --2- 172.21.15.154:0/3591059878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c0cf780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.536+0000 7f4a82be2640 1 -- 172.21.15.154:0/3591059878 >> 172.21.15.154:0/3591059878 conn(0x7f4a7c0d1bb0 msgr2=0x7f4a7c0d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.536+0000 7f4a82be2640 1 -- 172.21.15.154:0/3591059878 shutdown_connections 2024-09-10T11:38:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.536+0000 7f4a82be2640 1 -- 172.21.15.154:0/3591059878 wait complete. 2024-09-10T11:38:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.537+0000 7f4a82be2640 1 Processor -- start 2024-09-10T11:38:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.537+0000 7f4a82be2640 1 -- start start 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a7c0cf0d0 0x7f4a7c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 0x7f4a7c0c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0afe00 con 0x7f4a7c15bca0 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0afc80 con 0x7f4a7c0cfef0 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7c0aff80 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a7bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 0x7f4a7c0c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a7c0cf0d0 0x7f4a7c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a7bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 0x7f4a7c0c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33254/0 (socket says 172.21.15.154:33254) 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a7bfff640 1 -- 172.21.15.154:0/1822374936 learned_addr learned my addr 172.21.15.154:0/1822374936 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:13.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8117f640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 -- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 msgr2=0x7f4a7c0c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 0x7f4a7c0c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 -- 172.21.15.154:0/1822374936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 msgr2=0x7f4a7c15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 -- 172.21.15.154:0/1822374936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c0c6600 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a7bfff640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 0x7f4a7c0c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a8097e640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a7c0cf0d0 0x7f4a7c0c9b30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a70031000 tx=0x7f4a70033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70005c90 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a70031e50 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c0ca160 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.538+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70005260 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.539+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c0c6ec0 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.539+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a700047a0 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.539+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4a700336c0 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.539+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c071450 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.541+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4a7c071450 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.612+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dd781c85-161f-4605-aa0c-bee88f13f236", "id": 2} v 0) -- 0x7f4a7c0d0590 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a797fa640 1 -- 172.21.15.154:0/1822374936 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd781c85-161f-4605-aa0c-bee88f13f236", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4a7003f030 con 0x7f4a7c0cf0d0 2024-09-10T11:38:13.616 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-10T11:38:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a7c0cf0d0 msgr2=0x7f4a7c0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a82be2640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a7c0cf0d0 0x7f4a7c0c9b30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a70031000 tx=0x7f4a70033c20 comp rx=0 tx=0).stop 2024-09-10T11:38:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 shutdown_connections 2024-09-10T11:38:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a82be2640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a7c15bca0 0x7f4a7c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a82be2640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a7c0cfef0 0x7f4a7c0c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.615+0000 7f4a82be2640 1 --2- 172.21.15.154:0/1822374936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a7c0cf0d0 0x7f4a7c0c9b30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.616+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 >> 172.21.15.154:0/1822374936 conn(0x7f4a7c0d1bb0 msgr2=0x7f4a7c0b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.616+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 shutdown_connections 2024-09-10T11:38:13.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.616+0000 7f4a82be2640 1 -- 172.21.15.154:0/1822374936 wait complete. 2024-09-10T11:38:13.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 630caf47-2b92-445f-ac9b-8bb106572602 3 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 -- 172.21.15.154:0/909786263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300738f0 msgr2=0x7f8b3006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 --2- 172.21.15.154:0/909786263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300738f0 0x7f8b3006f830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8b3015afb0 tx=0x7f8b2802aa30 comp rx=0 tx=0).stop 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 -- 172.21.15.154:0/909786263 shutdown_connections 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 --2- 172.21.15.154:0/909786263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300738f0 0x7f8b3006f830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 --2- 172.21.15.154:0/909786263 >> v2:172.21.15.57:3300/0 conn(0x7f8b300c73e0 0x7f8b3015bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 -- 172.21.15.154:0/909786263 >> 172.21.15.154:0/909786263 conn(0x7f8b300cd4e0 msgr2=0x7f8b300cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 -- 172.21.15.154:0/909786263 shutdown_connections 2024-09-10T11:38:13.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.727+0000 7f8b365f5640 1 -- 172.21.15.154:0/909786263 wait complete. 2024-09-10T11:38:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.728+0000 7f8b365f5640 1 Processor -- start 2024-09-10T11:38:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.728+0000 7f8b365f5640 1 -- start start 2024-09-10T11:38:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b365f5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b300738f0 0x7f8b301447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b365f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b300c5900 0x7f8b300b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b365f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 0x7f8b300b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b365f5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300cfcb0 con 0x7f8b300738f0 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b365f5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300cfb30 con 0x7f8b300c73e0 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b365f5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8b300cfe30 con 0x7f8b300c5900 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b34b92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 0x7f8b300b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b34b92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 0x7f8b300b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33280/0 (socket says 172.21.15.154:33280) 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b34b92640 1 -- 172.21.15.154:0/3874609675 learned_addr learned my addr 172.21.15.154:0/3874609675 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b2f7fe640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b300c5900 0x7f8b300b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b2ffff640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b300738f0 0x7f8b301447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b34b92640 1 -- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b300c5900 msgr2=0x7f8b300b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.729+0000 7f8b34b92640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b300c5900 0x7f8b300b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b34b92640 1 -- 172.21.15.154:0/3874609675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b300738f0 msgr2=0x7f8b301447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b34b92640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b300738f0 0x7f8b301447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b34b92640 1 -- 172.21.15.154:0/3874609675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b300b3990 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b34b92640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 0x7f8b300b5700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009d60 tx=0x7f8b28003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28033050 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b28004450 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b300b3c70 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28038450 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b300b4230 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b28036070 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.730+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8b28038c60 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.731+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3006f830 con 0x7f8b300c73e0 2024-09-10T11:38:13.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.733+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8b280387d0 con 0x7f8b300c73e0 2024-09-10T11:38:13.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.804+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "630caf47-2b92-445f-ac9b-8bb106572602", "id": 3} v 0) -- 0x7f8b30069340 con 0x7f8b300c73e0 2024-09-10T11:38:13.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.808+0000 7f8b2cff9640 1 -- 172.21.15.154:0/3874609675 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "630caf47-2b92-445f-ac9b-8bb106572602", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8b28038a10 con 0x7f8b300c73e0 2024-09-10T11:38:13.809 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-09-10T11:38:13.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 msgr2=0x7f8b300b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 0x7f8b300b5700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009d60 tx=0x7f8b28003f10 comp rx=0 tx=0).stop 2024-09-10T11:38:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 shutdown_connections 2024-09-10T11:38:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b300c73e0 0x7f8b300b5700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b300c5900 0x7f8b300b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 --2- 172.21.15.154:0/3874609675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b300738f0 0x7f8b301447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 >> 172.21.15.154:0/3874609675 conn(0x7f8b300cd4e0 msgr2=0x7f8b300c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 shutdown_connections 2024-09-10T11:38:13.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.809+0000 7f8b365f5640 1 -- 172.21.15.154:0/3874609675 wait complete. 2024-09-10T11:38:13.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1719d3e3-0400-40cb-a07e-571586f93917 4 2024-09-10T11:38:13.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 -- 172.21.15.154:0/3326208305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 msgr2=0x7f1fd415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 --2- 172.21.15.154:0/3326208305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415bac0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009830 tx=0x7f1fc402a480 comp rx=0 tx=0).stop 2024-09-10T11:38:13.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 -- 172.21.15.154:0/3326208305 shutdown_connections 2024-09-10T11:38:13.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 --2- 172.21.15.154:0/3326208305 >> v2:172.21.15.57:3300/0 conn(0x7f1fd40738f0 0x7f1fd406f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 --2- 172.21.15.154:0/3326208305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415bac0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 -- 172.21.15.154:0/3326208305 >> 172.21.15.154:0/3326208305 conn(0x7f1fd40cd4e0 msgr2=0x7f1fd40cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:13.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 -- 172.21.15.154:0/3326208305 shutdown_connections 2024-09-10T11:38:13.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.921+0000 7f1fdc524640 1 -- 172.21.15.154:0/3326208305 wait complete. 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.922+0000 7f1fdc524640 1 Processor -- start 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 -- start start 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd40738f0 0x7f1fd414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 0x7f1fd406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40cfd30 con 0x7f1fd40738f0 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40cfbb0 con 0x7f1fd40c5900 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdc524640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd40cfeb0 con 0x7f1fd40c73e0 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fd9abf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 0x7f1fd406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdaac1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fd9abf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 0x7f1fd406cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33284/0 (socket says 172.21.15.154:33284) 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fdaac1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49962/0 (socket says 172.21.15.154:49962) 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fd9abf640 1 -- 172.21.15.154:0/1450972681 learned_addr learned my addr 172.21.15.154:0/1450972681 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.923+0000 7f1fda2c0640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd40738f0 0x7f1fd414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fd9abf640 1 -- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 msgr2=0x7f1fd415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fd9abf640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fd9abf640 1 -- 172.21.15.154:0/1450972681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd40738f0 msgr2=0x7f1fd414aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fd9abf640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd40738f0 0x7f1fd414aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fd9abf640 1 -- 172.21.15.154:0/1450972681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd414b2e0 con 0x7f1fd40c5900 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fdaac1640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fd9abf640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 0x7f1fd406cb40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000c490 tx=0x7f1fd000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0016020 con 0x7f1fd40c5900 2024-09-10T11:38:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fd0012940 con 0x7f1fd40c5900 2024-09-10T11:38:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0012d90 con 0x7f1fd40c5900 2024-09-10T11:38:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd41f5cc0 con 0x7f1fd40c5900 2024-09-10T11:38:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd41f6280 con 0x7f1fd40c5900 2024-09-10T11:38:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1fd0019020 con 0x7f1fd40c5900 2024-09-10T11:38:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.924+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1fd001adb0 con 0x7f1fd40c5900 2024-09-10T11:38:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.925+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd40d0360 con 0x7f1fd40c5900 2024-09-10T11:38:13.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.929+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1fd0020030 con 0x7f1fd40c5900 2024-09-10T11:38:14.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:13.999+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1719d3e3-0400-40cb-a07e-571586f93917", "id": 4} v 0) -- 0x7f1fd41f6450 con 0x7f1fd40c5900 2024-09-10T11:38:14.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.007+0000 7f1fcaffd640 1 -- 172.21.15.154:0/1450972681 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1719d3e3-0400-40cb-a07e-571586f93917", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1fd001a860 con 0x7f1fd40c5900 2024-09-10T11:38:14.008 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-09-10T11:38:14.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 msgr2=0x7f1fd406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 0x7f1fd406cb40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000c490 tx=0x7f1fd000c950 comp rx=0 tx=0).stop 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 shutdown_connections 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd40c73e0 0x7f1fd415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd40c5900 0x7f1fd406cb40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 --2- 172.21.15.154:0/1450972681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd40738f0 0x7f1fd414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 >> 172.21.15.154:0/1450972681 conn(0x7f1fd40cd4e0 msgr2=0x7f1fd40c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 shutdown_connections 2024-09-10T11:38:14.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.008+0000 7f1fdc524640 1 -- 172.21.15.154:0/1450972681 wait complete. 2024-09-10T11:38:14.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new c073452c-dd49-409f-84d9-6c82677dd8dc 5 2024-09-10T11:38:14.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2016549272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc15a8f0 msgr2=0x7fc3cc0731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2016549272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc15a8f0 0x7fc3cc0731c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005fd0 tx=0x7fc3c002a5c0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2016549272 shutdown_connections 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2016549272 >> v2:172.21.15.57:3300/0 conn(0x7fc3cc073700 0x7fc3cc0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2016549272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc15a8f0 0x7fc3cc0731c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2016549272 >> 172.21.15.154:0/2016549272 conn(0x7fc3cc0cd420 msgr2=0x7fc3cc0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2016549272 shutdown_connections 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.120+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2016549272 wait complete. 2024-09-10T11:38:14.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.121+0000 7fc3d2b64640 1 Processor -- start 2024-09-10T11:38:14.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.121+0000 7fc3d2b64640 1 -- start start 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d2b64640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 0x7fc3cc1f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d2b64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc0cfab0 0x7fc3cc1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d2b64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3cc15a8f0 0x7fc3cc06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d2b64640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc15eb10 con 0x7fc3cc0cfab0 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d2b64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc0cd000 con 0x7fc3cc15a8f0 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d2b64640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc15ec90 con 0x7fc3cc073700 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 0x7fc3cc1f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 0x7fc3cc1f8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49972/0 (socket says 172.21.15.154:49972) 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 -- 172.21.15.154:0/2415712367 learned_addr learned my addr 172.21.15.154:0/2415712367 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:14.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d1101640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3cc15a8f0 0x7fc3cc06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3cbfff640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc0cfab0 0x7fc3cc1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 -- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3cc15a8f0 msgr2=0x7fc3cc06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3cc15a8f0 0x7fc3cc06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 -- 172.21.15.154:0/2415712367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc0cfab0 msgr2=0x7fc3cc1f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc0cfab0 0x7fc3cc1f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 -- 172.21.15.154:0/2415712367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc1f85a0 con 0x7fc3cc073700 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.122+0000 7fc3d0900640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 0x7fc3cc1f8060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0006010 tx=0x7fc3c00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c003e030 con 0x7fc3cc073700 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c0003d90 con 0x7fc3cc073700 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc06fcc0 con 0x7fc3cc073700 2024-09-10T11:38:14.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0035040 con 0x7fc3cc073700 2024-09-10T11:38:14.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc070280 con 0x7fc3cc073700 2024-09-10T11:38:14.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc3c0041030 con 0x7fc3cc073700 2024-09-10T11:38:14.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.123+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc3c0043d00 con 0x7fc3cc073700 2024-09-10T11:38:14.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.124+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc15f1b0 con 0x7fc3cc073700 2024-09-10T11:38:14.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.125+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc3cc1f85a0 con 0x7fc3cc073700 2024-09-10T11:38:14.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.196+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c073452c-dd49-409f-84d9-6c82677dd8dc", "id": 5} v 0) -- 0x7fc3cc0708d0 con 0x7fc3cc073700 2024-09-10T11:38:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.204+0000 7fc3c97fa640 1 -- 172.21.15.154:0/2415712367 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c073452c-dd49-409f-84d9-6c82677dd8dc", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc3c0004f50 con 0x7fc3cc073700 2024-09-10T11:38:14.206 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 msgr2=0x7fc3cc1f8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 0x7fc3cc1f8060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0006010 tx=0x7fc3c00038a0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 shutdown_connections 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3cc15a8f0 0x7fc3cc06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc0cfab0 0x7fc3cc1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 --2- 172.21.15.154:0/2415712367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3cc073700 0x7fc3cc1f8060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 >> 172.21.15.154:0/2415712367 conn(0x7fc3cc0cd420 msgr2=0x7fc3cc159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 shutdown_connections 2024-09-10T11:38:14.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.205+0000 7fc3d2b64640 1 -- 172.21.15.154:0/2415712367 wait complete. 2024-09-10T11:38:14.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 3f045575-8039-4ab3-ac23-43c062dd06d2 6 2024-09-10T11:38:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.316+0000 7fcfe2440640 1 -- 172.21.15.154:0/306629855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc15a8f0 msgr2=0x7fcfdc0731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.316+0000 7fcfe2440640 1 --2- 172.21.15.154:0/306629855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0731c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009830 tx=0x7fcfc402a5c0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.316+0000 7fcfe2440640 1 -- 172.21.15.154:0/306629855 shutdown_connections 2024-09-10T11:38:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.316+0000 7fcfe2440640 1 --2- 172.21.15.154:0/306629855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0731c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.316+0000 7fcfe2440640 1 -- 172.21.15.154:0/306629855 >> 172.21.15.154:0/306629855 conn(0x7fcfdc0cd420 msgr2=0x7fcfdc0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.317+0000 7fcfe2440640 1 -- 172.21.15.154:0/306629855 shutdown_connections 2024-09-10T11:38:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.317+0000 7fcfe2440640 1 -- 172.21.15.154:0/306629855 wait complete. 2024-09-10T11:38:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.318+0000 7fcfe2440640 1 Processor -- start 2024-09-10T11:38:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.318+0000 7fcfe2440640 1 -- start start 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 0x7fcfdc0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc0cfc80 0x7fcfdc0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc0cc880 con 0x7fcfdc0cfc80 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc0cc700 con 0x7fcfdc15a8f0 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc0cca00 con 0x7fcfdc073700 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 0x7fcfdc0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe09dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe09dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33314/0 (socket says 172.21.15.154:33314) 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 0x7fcfdc0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49988/0 (socket says 172.21.15.154:49988) 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe09dd640 1 -- 172.21.15.154:0/1869772516 learned_addr learned my addr 172.21.15.154:0/1869772516 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdb7fe640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc0cfc80 0x7fcfdc0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 -- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfdc15a8f0 msgr2=0x7fcfdc0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 -- 172.21.15.154:0/1869772516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc0cfc80 msgr2=0x7fcfdc0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc0cfc80 0x7fcfdc0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 -- 172.21.15.154:0/1869772516 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc0b5030 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfdbfff640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 0x7fcfdc0b4770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4031000 tx=0x7fcfc4033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4031b50 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfc4031de0 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4005280 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.319+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc0b5310 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.320+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc14a880 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.320+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcfc40047a0 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.320+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcfc4033760 con 0x7fcfdc073700 2024-09-10T11:38:14.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.320+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfdc0ccf50 con 0x7fcfdc073700 2024-09-10T11:38:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.322+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcfc403f030 con 0x7fcfdc073700 2024-09-10T11:38:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.393+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f045575-8039-4ab3-ac23-43c062dd06d2", "id": 6} v 0) -- 0x7fcfdc0b1e40 con 0x7fcfdc073700 2024-09-10T11:38:14.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.397+0000 7fcfd8ff9640 1 -- 172.21.15.154:0/1869772516 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f045575-8039-4ab3-ac23-43c062dd06d2", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcfc4031770 con 0x7fcfdc073700 2024-09-10T11:38:14.398 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-09-10T11:38:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 msgr2=0x7fcfdc0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 0x7fcfdc0b4770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4031000 tx=0x7fcfc4033ba0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 shutdown_connections 2024-09-10T11:38:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfdc15a8f0 0x7fcfdc0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfdc0cfc80 0x7fcfdc0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 --2- 172.21.15.154:0/1869772516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfdc073700 0x7fcfdc0b4770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 >> 172.21.15.154:0/1869772516 conn(0x7fcfdc0cd420 msgr2=0x7fcfdc0cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 shutdown_connections 2024-09-10T11:38:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.398+0000 7fcfe2440640 1 -- 172.21.15.154:0/1869772516 wait complete. 2024-09-10T11:38:14.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new f9f4fbaf-9067-44eb-9a0a-546ac2febd90 7 2024-09-10T11:38:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 -- 172.21.15.154:0/1271847597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde00d1e40 msgr2=0x7efde00ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 --2- 172.21.15.154:0/1271847597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde00d1e40 0x7efde00ce4d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efde00d09d0 tx=0x7efdd802a780 comp rx=0 tx=0).stop 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 -- 172.21.15.154:0/1271847597 shutdown_connections 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 --2- 172.21.15.154:0/1271847597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde00d1e40 0x7efde00ce4d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 --2- 172.21.15.154:0/1271847597 >> v2:172.21.15.154:3300/0 conn(0x7efde00cf690 0x7efde00d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 --2- 172.21.15.154:0/1271847597 >> v2:172.21.15.57:3300/0 conn(0x7efde015bc40 0x7efde00cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 -- 172.21.15.154:0/1271847597 >> 172.21.15.154:0/1271847597 conn(0x7efde009aa20 msgr2=0x7efde009ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 -- 172.21.15.154:0/1271847597 shutdown_connections 2024-09-10T11:38:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.511+0000 7efde71c2640 1 -- 172.21.15.154:0/1271847597 wait complete. 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.512+0000 7efde71c2640 1 Processor -- start 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 -- start start 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efde00cf690 0x7efde014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 0x7efde014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde015bc40 0x7efde00b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efde00ceda0 con 0x7efde00cf690 2024-09-10T11:38:14.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efde00cec20 con 0x7efde00d1e40 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.513+0000 7efde71c2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efde00cef20 con 0x7efde015bc40 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 0x7efde014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efde575f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde015bc40 0x7efde00b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 0x7efde014de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33342/0 (socket says 172.21.15.154:33342) 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efde575f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde015bc40 0x7efde00b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50004/0 (socket says 172.21.15.154:50004) 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 -- 172.21.15.154:0/2152863592 learned_addr learned my addr 172.21.15.154:0/2152863592 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efde4f5e640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efde00cf690 0x7efde014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 -- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde015bc40 msgr2=0x7efde00b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde015bc40 0x7efde00b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 -- 172.21.15.154:0/2152863592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efde00cf690 msgr2=0x7efde014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efde00cf690 0x7efde014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 -- 172.21.15.154:0/2152863592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde006f7f0 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddffff640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 0x7efde014de60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efdcc005c80 tx=0x7efdcc00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00cd80 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdcc004030 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde0150720 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004460 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde0150ce0 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.514+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efdcc0053b0 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.515+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7efdcc003730 con 0x7efde00d1e40 2024-09-10T11:38:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.515+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde00c7150 con 0x7efde00d1e40 2024-09-10T11:38:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.517+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efde006f7f0 con 0x7efde00d1e40 2024-09-10T11:38:14.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.589+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9f4fbaf-9067-44eb-9a0a-546ac2febd90", "id": 7} v 0) -- 0x7efde00c6e70 con 0x7efde00d1e40 2024-09-10T11:38:14.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.592+0000 7efddd7fa640 1 -- 172.21.15.154:0/2152863592 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9f4fbaf-9067-44eb-9a0a-546ac2febd90", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7efdcc003a00 con 0x7efde00d1e40 2024-09-10T11:38:14.593 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 msgr2=0x7efde014de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 0x7efde014de60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efdcc005c80 tx=0x7efdcc00ee00 comp rx=0 tx=0).stop 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 shutdown_connections 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efde015bc40 0x7efde00b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efde00d1e40 0x7efde014de60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 --2- 172.21.15.154:0/2152863592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efde00cf690 0x7efde014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 >> 172.21.15.154:0/2152863592 conn(0x7efde009aa20 msgr2=0x7efde00c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 shutdown_connections 2024-09-10T11:38:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T11:38:14.593+0000 7efde71c2640 1 -- 172.21.15.154:0/2152863592 wait complete. 2024-09-10T11:38:14.605 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T11:38:14.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T11:38:14.607 INFO:tasks.ceph.osd.0:Started 2024-09-10T11:38:14.607 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T11:38:14.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T11:38:14.609 INFO:tasks.ceph.osd.1:Started 2024-09-10T11:38:14.609 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T11:38:14.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T11:38:14.612 INFO:tasks.ceph.osd.2:Started 2024-09-10T11:38:14.612 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T11:38:14.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T11:38:14.614 INFO:tasks.ceph.osd.3:Started 2024-09-10T11:38:14.615 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T11:38:14.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T11:38:14.618 INFO:tasks.ceph.osd.4:Started 2024-09-10T11:38:14.618 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T11:38:14.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T11:38:14.621 INFO:tasks.ceph.osd.5:Started 2024-09-10T11:38:14.621 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T11:38:14.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T11:38:14.625 INFO:tasks.ceph.osd.6:Started 2024-09-10T11:38:14.626 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T11:38:14.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T11:38:14.630 INFO:tasks.ceph.osd.7:Started 2024-09-10T11:38:14.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:14.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 -- 172.21.15.57:0/3845082134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f415a870 msgr2=0x7fb6f40705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3845082134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f415a870 0x7fb6f40705b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40c7a00 tx=0x7fb6f002a5f0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 -- 172.21.15.57:0/3845082134 shutdown_connections 2024-09-10T11:38:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3845082134 >> v2:172.21.15.154:3300/0 conn(0x7fb6f4070af0 0x7fb6f40cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3845082134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f415a870 0x7fb6f40705b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 -- 172.21.15.57:0/3845082134 >> 172.21.15.57:0/3845082134 conn(0x7fb6f40b2540 msgr2=0x7fb6f40b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 -- 172.21.15.57:0/3845082134 shutdown_connections 2024-09-10T11:38:14.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.753+0000 7fb6fb816640 1 -- 172.21.15.57:0/3845082134 wait complete. 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.754+0000 7fb6fb816640 1 Processor -- start 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.754+0000 7fb6fb816640 1 -- start start 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6fb816640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6f4070af0 0x7fb6f40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6fb816640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 0x7fb6f415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6fb816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f415a870 0x7fb6f415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6fb816640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f415ae40 con 0x7fb6f40cf340 2024-09-10T11:38:14.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6fb816640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40cd510 con 0x7fb6f415a870 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6fb816640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f4073910 con 0x7fb6f4070af0 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 0x7fb6f415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 0x7fb6f415b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33416/0 (socket says 172.21.15.57:33416) 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 -- 172.21.15.57:0/3040358785 learned_addr learned my addr 172.21.15.57:0/3040358785 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f9db3640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f415a870 0x7fb6f415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f95b2640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6f4070af0 0x7fb6f40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 -- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6f4070af0 msgr2=0x7fb6f40ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6f4070af0 0x7fb6f40ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 -- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f415a870 msgr2=0x7fb6f415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f415a870 0x7fb6f415c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.755+0000 7fb6f8db1640 1 -- 172.21.15.57:0/3040358785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f40af740 con 0x7fb6f40cf340 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6f8db1640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 0x7fb6f415b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800e9c0 tx=0x7fb6e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e800cd80 con 0x7fb6f40cf340 2024-09-10T11:38:14.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6e8004020 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8004450 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f40ae6a0 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6e8003980 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f40aec60 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.756+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb6e8003e00 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.757+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f4073d70 con 0x7fb6f40cf340 2024-09-10T11:38:14.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.759+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb6e8018430 con 0x7fb6f40cf340 2024-09-10T11:38:14.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.822+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6f40caf90 con 0x7fb6f40cf340 2024-09-10T11:38:14.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.822+0000 7fb6e5ffb640 1 -- 172.21.15.57:0/3040358785 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb6e8027090 con 0x7fb6f40cf340 2024-09-10T11:38:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:14.824 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:14.590913+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:14.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 msgr2=0x7fb6f415b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:14.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 0x7fb6f415b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800e9c0 tx=0x7fb6e800ee80 comp rx=0 tx=0).stop 2024-09-10T11:38:14.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 shutdown_connections 2024-09-10T11:38:14.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6f415a870 0x7fb6f415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6f40cf340 0x7fb6f415b880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 --2- 172.21.15.57:0/3040358785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6f4070af0 0x7fb6f40ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 >> 172.21.15.57:0/3040358785 conn(0x7fb6f40b2540 msgr2=0x7fb6f40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 shutdown_connections 2024-09-10T11:38:14.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:14.823+0000 7fb6fb816640 1 -- 172.21.15.57:0/3040358785 wait complete. 2024-09-10T11:38:14.835 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T11:38:14.836 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T11:38:15.642 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 -- 172.21.15.57:0/3161559607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f006f6a0 msgr2=0x7ff3f015e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 --2- 172.21.15.57:0/3161559607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f006f6a0 0x7ff3f015e630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8005fd0 tx=0x7ff3d802a5d0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 -- 172.21.15.57:0/3161559607 shutdown_connections 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 --2- 172.21.15.57:0/3161559607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f006f6a0 0x7ff3f015e630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 --2- 172.21.15.57:0/3161559607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 -- 172.21.15.57:0/3161559607 >> 172.21.15.57:0/3161559607 conn(0x7ff3f006d980 msgr2=0x7ff3f006dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 -- 172.21.15.57:0/3161559607 shutdown_connections 2024-09-10T11:38:15.739 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.736+0000 7ff3f607f640 1 -- 172.21.15.57:0/3161559607 wait complete. 2024-09-10T11:38:15.740 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.738+0000 7ff3f607f640 1 Processor -- start 2024-09-10T11:38:15.740 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.738+0000 7ff3f607f640 1 -- start start 2024-09-10T11:38:15.742 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3f607f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 0x7ff3f01f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:15.742 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3f607f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f01f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:15.742 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3f607f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f015eb70 0x7ff3f00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:15.742 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3f607f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f015b750 con 0x7ff3f015eb70 2024-09-10T11:38:15.742 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3f607f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f015d9e0 con 0x7ff3f006f6a0 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3f607f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f015b8d0 con 0x7ff3f00d0510 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f015eb70 0x7ff3f00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 0x7ff3f01f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3e6ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f01f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3e6ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f01f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:33898/0 (socket says 172.21.15.57:33898) 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3e6ffd640 1 -- 172.21.15.57:0/422625585 learned_addr learned my addr 172.21.15.57:0/422625585 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 0x7ff3f01f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:42642/0 (socket says 172.21.15.57:42642) 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 -- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 msgr2=0x7ff3f01f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f01f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 -- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 msgr2=0x7ff3f01f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 0x7ff3f01f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 -- 172.21.15.57:0/422625585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f01f6ca0 con 0x7ff3f015eb70 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3ef7fe640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 0x7ff3f01f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:15.743 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3e6ffd640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f01f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.739+0000 7ff3effff640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f015eb70 0x7ff3f00cc580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800c760 tx=0x7ff3e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8003b70 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e8003d10 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f015ab80 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800aab0 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f01f2b50 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff3e800ac50 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.740+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff3e8012be0 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.741+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f015e380 con 0x7ff3f015eb70 2024-09-10T11:38:15.744 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.743+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff3f01f6ca0 con 0x7ff3f015eb70 2024-09-10T11:38:15.807 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.805+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3f015bdf0 con 0x7ff3f015eb70 2024-09-10T11:38:15.807 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.805+0000 7ff3ecff9640 1 -- 172.21.15.57:0/422625585 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff3e8012510 con 0x7ff3f015eb70 2024-09-10T11:38:15.807 INFO:teuthology.misc.health.smithi057.stdout: 2024-09-10T11:38:15.807 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:14.590913+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:15.808 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f015eb70 msgr2=0x7ff3f00cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:15.808 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f015eb70 0x7ff3f00cc580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800c760 tx=0x7ff3e800cc20 comp rx=0 tx=0).stop 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 shutdown_connections 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f015eb70 0x7ff3f00cc580 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3f00d0510 0x7ff3f01f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 --2- 172.21.15.57:0/422625585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3f006f6a0 0x7ff3f01f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 >> 172.21.15.57:0/422625585 conn(0x7ff3f006d980 msgr2=0x7ff3f0073b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 shutdown_connections 2024-09-10T11:38:15.809 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:15.806+0000 7ff3f607f640 1 -- 172.21.15.57:0/422625585 wait complete. 2024-09-10T11:38:15.817 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T11:38:15.832 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-09-10T11:38:15.830+0000 7f739fa14640 -1 Falling back to public interface 2024-09-10T11:38:16.059 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T11:38:16.058+0000 7fd464816640 -1 Falling back to public interface 2024-09-10T11:38:16.107 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-09-10T11:38:16.106+0000 7fd9495a6640 -1 Falling back to public interface 2024-09-10T11:38:16.116 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T11:38:16.115+0000 7f1b5260d640 -1 Falling back to public interface 2024-09-10T11:38:16.178 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:16.177+0000 7f56497ef040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-10T11:38:16.321 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-09-10T11:38:16.319+0000 7fd41deb2640 -1 Falling back to public interface 2024-09-10T11:38:16.325 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T11:38:16.323+0000 7f2f31c11640 -1 Falling back to public interface 2024-09-10T11:38:16.337 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-09-10T11:38:16.335+0000 7fd5b3dd4640 -1 Falling back to public interface 2024-09-10T11:38:16.353 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T11:38:16.352+0000 7f86b7e0d640 -1 Falling back to public interface 2024-09-10T11:38:16.472 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-09-10T11:38:16.470+0000 7fd1ab62e040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-10T11:38:17.195 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:17.193+0000 7f55e972f640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T11:38:17.195 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T11:38:17.194+0000 7f55e972f640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T11:38:19.652 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T11:38:19.651+0000 7f1b5260d640 -1 osd.7 0 log_to_monitors true 2024-09-10T11:38:19.860 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T11:38:19.859+0000 7fd464816640 -1 osd.4 0 log_to_monitors true 2024-09-10T11:38:19.932 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-09-10T11:38:19.930+0000 7f739fa14640 -1 osd.3 0 log_to_monitors true 2024-09-10T11:38:20.111 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-09-10T11:38:20.110+0000 7fd41deb2640 -1 osd.2 0 log_to_monitors true 2024-09-10T11:38:20.158 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-09-10T11:38:20.157+0000 7fd9495a6640 -1 osd.1 0 log_to_monitors true 2024-09-10T11:38:20.163 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-09-10T11:38:20.162+0000 7fd5b3dd4640 -1 osd.0 0 log_to_monitors true 2024-09-10T11:38:20.178 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T11:38:20.177+0000 7f86b7e0d640 -1 osd.5 0 log_to_monitors true 2024-09-10T11:38:20.583 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T11:38:20.582+0000 7f2f31c11640 -1 osd.6 0 log_to_monitors true 2024-09-10T11:38:22.624 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:22.838 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 -- 172.21.15.57:0/2214345817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340c87e0 msgr2=0x7f463416d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:22.838 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 --2- 172.21.15.57:0/2214345817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340c87e0 0x7f463416d0f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f462c009be0 tx=0x7f462c02a920 comp rx=0 tx=0).stop 2024-09-10T11:38:22.838 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 -- 172.21.15.57:0/2214345817 shutdown_connections 2024-09-10T11:38:22.838 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 --2- 172.21.15.57:0/2214345817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340c87e0 0x7f463416d0f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:22.838 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 -- 172.21.15.57:0/2214345817 >> 172.21.15.57:0/2214345817 conn(0x7f463406c870 msgr2=0x7f463406cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:22.841 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 -- 172.21.15.57:0/2214345817 shutdown_connections 2024-09-10T11:38:22.841 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.836+0000 7f463b717640 1 -- 172.21.15.57:0/2214345817 wait complete. 2024-09-10T11:38:22.841 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.838+0000 7f463b717640 1 Processor -- start 2024-09-10T11:38:22.841 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.838+0000 7f463b717640 1 -- start start 2024-09-10T11:38:22.842 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.840+0000 7f463b717640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340cd780 0x7f46340cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:22.842 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.840+0000 7f463b717640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46340cf810 0x7f46340ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:22.842 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.840+0000 7f463b717640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 0x7f463416b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:22.843 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.840+0000 7f463b717640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f463416d7b0 con 0x7f46340cf810 2024-09-10T11:38:22.843 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.841+0000 7f463b717640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f463416d630 con 0x7f463414ef50 2024-09-10T11:38:22.843 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.841+0000 7f4639cb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 0x7f463416b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:22.843 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.841+0000 7f4639cb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 0x7f463416b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:48478/0 (socket says 172.21.15.57:48478) 2024-09-10T11:38:22.843 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.841+0000 7f4639cb4640 1 -- 172.21.15.57:0/3153135430 learned_addr learned my addr 172.21.15.57:0/3153135430 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:22.843 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.841+0000 7f463b717640 1 -- 172.21.15.57:0/3153135430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f463416d930 con 0x7f46340cd780 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4639cb4640 1 -- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340cd780 msgr2=0x7f46340cac80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4639cb4640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340cd780 0x7f46340cac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4639cb4640 1 -- 172.21.15.57:0/3153135430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46340cf810 msgr2=0x7f46340ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4638cb2640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46340cf810 0x7f46340ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4639cb4640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46340cf810 0x7f46340ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4639cb4640 1 -- 172.21.15.57:0/3153135430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46340cb3a0 con 0x7f463414ef50 2024-09-10T11:38:22.844 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.842+0000 7f4638cb2640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46340cf810 0x7f46340ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:22.845 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.843+0000 7f4639cb4640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 0x7f463416b680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f462c006010 tx=0x7f462c003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:22.851 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.849+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c004240 con 0x7f463414ef50 2024-09-10T11:38:22.851 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.849+0000 7f463b717640 1 -- 172.21.15.57:0/3153135430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4634152a80 con 0x7f463414ef50 2024-09-10T11:38:22.851 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.850+0000 7f463b717640 1 -- 172.21.15.57:0/3153135430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4634153040 con 0x7f463414ef50 2024-09-10T11:38:22.852 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.850+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f462c0043e0 con 0x7f463414ef50 2024-09-10T11:38:22.853 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.852+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462c004810 con 0x7f463414ef50 2024-09-10T11:38:22.855 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.854+0000 7f463b717640 1 -- 172.21.15.57:0/3153135430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4614005290 con 0x7f463414ef50 2024-09-10T11:38:22.972 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.969+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) ==== 97972+0+0 (secure 0 0 0) 0x7f462c03a450 con 0x7f463414ef50 2024-09-10T11:38:22.973 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.970+0000 7f4629ffb640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f46180750e0 0x7f46180775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:22.973 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.970+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f462c0b7320 con 0x7f463414ef50 2024-09-10T11:38:22.973 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.971+0000 7f46394b3640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f46180750e0 0x7f46180775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:22.973 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.971+0000 7f46394b3640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f46180750e0 0x7f46180775a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4624001580 tx=0x7f4624007a10 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:22.974 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:22.972+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f462c02d070 con 0x7f463414ef50 2024-09-10T11:38:23.330 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.329+0000 7f463b717640 1 -- 172.21.15.57:0/3153135430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4614005850 con 0x7f463414ef50 2024-09-10T11:38:23.331 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.330+0000 7f4629ffb640 1 -- 172.21.15.57:0/3153135430 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f462c081f40 con 0x7f463414ef50 2024-09-10T11:38:23.332 INFO:teuthology.misc.health.smithi057.stdout: 2024-09-10T11:38:23.332 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":12,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:21.597444+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:23.336 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.334+0000 7f461f7fe640 1 -- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f46180750e0 msgr2=0x7f46180775a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:23.336 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.334+0000 7f461f7fe640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f46180750e0 0x7f46180775a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4624001580 tx=0x7f4624007a10 comp rx=0 tx=0).stop 2024-09-10T11:38:23.336 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.334+0000 7f461f7fe640 1 -- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 msgr2=0x7f463416b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:23.336 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.334+0000 7f461f7fe640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 0x7f463416b680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f462c006010 tx=0x7f462c003f10 comp rx=0 tx=0).stop 2024-09-10T11:38:23.337 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.334+0000 7f461f7fe640 1 -- 172.21.15.57:0/3153135430 shutdown_connections 2024-09-10T11:38:23.337 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f46180750e0 0x7f46180775a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:23.337 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f463414ef50 0x7f463416b680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:23.337 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46340cf810 0x7f46340ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:23.337 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 --2- 172.21.15.57:0/3153135430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46340cd780 0x7f46340cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:23.338 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 -- 172.21.15.57:0/3153135430 >> 172.21.15.57:0/3153135430 conn(0x7f463406c870 msgr2=0x7f46340b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:23.338 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 -- 172.21.15.57:0/3153135430 shutdown_connections 2024-09-10T11:38:23.338 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:23.335+0000 7f461f7fe640 1 -- 172.21.15.57:0/3153135430 wait complete. 2024-09-10T11:38:23.353 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T11:38:23.466 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-09-10T11:38:23.464+0000 7fd945d49640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T11:38:23.479 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-09-10T11:38:23.477+0000 7f739b37a640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T11:38:23.479 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-09-10T11:38:23.478+0000 7fd93d354640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.480 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-09-10T11:38:23.479+0000 7fd5afd63640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T11:38:23.492 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-09-10T11:38:23.491+0000 7f7393199640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.496 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-09-10T11:38:23.495+0000 7fd5a7b82640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.594 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-09-10T11:38:23.592+0000 7fd419e41640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T11:38:23.604 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-09-10T11:38:23.603+0000 7fd411c60640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.714 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T11:38:23.712+0000 7fd4601e1640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T11:38:23.714 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T11:38:23.713+0000 7f86b384b640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T11:38:23.715 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T11:38:23.714+0000 7f2f2dd01640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T11:38:23.718 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T11:38:23.716+0000 7f1b4e85f640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T11:38:23.724 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T11:38:23.723+0000 7fd458000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.729 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T11:38:23.728+0000 7f86ab66a640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.732 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T11:38:23.731+0000 7f2f2530c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:23.732 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T11:38:23.731+0000 7f1b45e6a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T11:38:30.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:38:30.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:38:30.160 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:30.303 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 -- 172.21.15.57:0/3621006032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 msgr2=0x7f9244003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.304 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 --2- 172.21.15.57:0/3621006032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f9244003ee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c530 tx=0x7f9244005830 comp rx=0 tx=0).stop 2024-09-10T11:38:30.304 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 -- 172.21.15.57:0/3621006032 shutdown_connections 2024-09-10T11:38:30.304 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 --2- 172.21.15.57:0/3621006032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f9244003ee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.304 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 -- 172.21.15.57:0/3621006032 >> 172.21.15.57:0/3621006032 conn(0x7f925c0d3d30 msgr2=0x7f925c0d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:30.304 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 -- 172.21.15.57:0/3621006032 shutdown_connections 2024-09-10T11:38:30.304 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.302+0000 7f926438a640 1 -- 172.21.15.57:0/3621006032 wait complete. 2024-09-10T11:38:30.306 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.303+0000 7f926438a640 1 Processor -- start 2024-09-10T11:38:30.306 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.303+0000 7f926438a640 1 -- start start 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f926438a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f925c09da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f926438a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c0ca7b0 0x7f925c15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f926438a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c15f250 0x7f925c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f926438a640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f925c0b3690 con 0x7f9244003aa0 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f926438a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f925c0b3510 con 0x7f925c0ca7b0 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f926438a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f925c0b3810 con 0x7f925c15f250 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f925c09da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f925c09da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56962/0 (socket says 172.21.15.57:56962) 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 -- 172.21.15.57:0/2556110159 learned_addr learned my addr 172.21.15.57:0/2556110159 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:30.307 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9261925640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c0ca7b0 0x7f925c15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262927640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c15f250 0x7f925c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 -- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c15f250 msgr2=0x7f925c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c15f250 0x7f925c15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 -- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c0ca7b0 msgr2=0x7f925c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c0ca7b0 0x7f925c15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.304+0000 7f9262126640 1 -- 172.21.15.57:0/2556110159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925c15d7a0 con 0x7f9244003aa0 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.305+0000 7f9262126640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f925c09da50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c560 tx=0x7f924c001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.305+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c039070 con 0x7f9244003aa0 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.305+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f924c02bb60 con 0x7f9244003aa0 2024-09-10T11:38:30.308 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.305+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925c1f4050 con 0x7f9244003aa0 2024-09-10T11:38:30.309 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.305+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c006070 con 0x7f9244003aa0 2024-09-10T11:38:30.309 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.305+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925c1f4610 con 0x7f9244003aa0 2024-09-10T11:38:30.310 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.306+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925c0b3d70 con 0x7f9244003aa0 2024-09-10T11:38:30.310 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.307+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f924c006210 con 0x7f9244003aa0 2024-09-10T11:38:30.310 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.307+0000 7f925affd640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f92480750a0 0x7f9248077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.310 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.307+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f924c0b6090 con 0x7f9244003aa0 2024-09-10T11:38:30.310 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.307+0000 7f9261925640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f92480750a0 0x7f9248077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.310 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.308+0000 7f9261925640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f92480750a0 0x7f9248077560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f925c1608d0 tx=0x7f9250005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:30.312 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.311+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f924c080800 con 0x7f9244003aa0 2024-09-10T11:38:30.471 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.470+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f925c0008d0 con 0x7f9244003aa0 2024-09-10T11:38:30.472 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.471+0000 7f925affd640 1 -- 172.21.15.57:0/2556110159 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f924c080100 con 0x7f9244003aa0 2024-09-10T11:38:30.472 INFO:teuthology.misc.health.smithi057.stdout: 2024-09-10T11:38:30.472 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":17,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:28.498818+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:30.474 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f92480750a0 msgr2=0x7f9248077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.474 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f92480750a0 0x7f9248077560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f925c1608d0 tx=0x7f9250005f90 comp rx=0 tx=0).stop 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 msgr2=0x7f925c09da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f925c09da50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c560 tx=0x7f924c001b20 comp rx=0 tx=0).stop 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 shutdown_connections 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f92480750a0 0x7f9248077560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c15f250 0x7f925c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c0ca7b0 0x7f925c15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 --2- 172.21.15.57:0/2556110159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9244003aa0 0x7f925c09da50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 >> 172.21.15.57:0/2556110159 conn(0x7f925c0d3d30 msgr2=0x7f925c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 shutdown_connections 2024-09-10T11:38:30.475 INFO:teuthology.misc.health.smithi057.stderr:2024-09-10T11:38:30.473+0000 7f926438a640 1 -- 172.21.15.57:0/2556110159 wait complete. 2024-09-10T11:38:30.484 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T11:38:30.484 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T11:38:30.485 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T11:38:30.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T11:38:30.487 INFO:tasks.ceph.mds.a:Started 2024-09-10T11:38:30.487 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T11:38:30.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T11:38:30.490 INFO:tasks.ceph.mds.c:Started 2024-09-10T11:38:30.490 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T11:38:30.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T11:38:30.494 INFO:tasks.ceph.mds.b:Started 2024-09-10T11:38:30.494 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T11:38:30.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T11:38:30.496 INFO:tasks.ceph.mds.d:Started 2024-09-10T11:38:30.497 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T11:38:30.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T11:38:30.566 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-09-10T11:38:30.566 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-09-10T11:38:30.580 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2024-09-10T11:38:30.581 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2024-09-10T11:38:30.582 INFO:tasks.ceph.mds.d.smithi154.stderr:2024-09-10T11:38:30.580+0000 7feb9b7d8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T11:38:30.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 -- 172.21.15.57:0/3987065659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 msgr2=0x7f7bec0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/3987065659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec0ce320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005fd0 tx=0x7f7bdc02a670 comp rx=0 tx=0).stop 2024-09-10T11:38:30.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 -- 172.21.15.57:0/3987065659 shutdown_connections 2024-09-10T11:38:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/3987065659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec0ce320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 -- 172.21.15.57:0/3987065659 >> 172.21.15.57:0/3987065659 conn(0x7f7bec09aa20 msgr2=0x7f7bec09ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 -- 172.21.15.57:0/3987065659 shutdown_connections 2024-09-10T11:38:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.607+0000 7f7bf0d24640 1 -- 172.21.15.57:0/3987065659 wait complete. 2024-09-10T11:38:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.608+0000 7f7bf0d24640 1 Processor -- start 2024-09-10T11:38:30.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.608+0000 7f7bf0d24640 1 -- start start 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bf0d24640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bec06de90 0x7f7bec1f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bf0d24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec0b2f70 0x7f7bec09da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bf0d24640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bf0d24640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec0b2a30 con 0x7f7bec15de60 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bf0d24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec0b28b0 con 0x7f7bec0b2f70 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bf0d24640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7bec06e320 con 0x7f7bec06de90 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec15afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57004/0 (socket says 172.21.15.57:57004) 2024-09-10T11:38:30.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 -- 172.21.15.57:0/1700296657 learned_addr learned my addr 172.21.15.57:0/1700296657 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bea59c640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bec06de90 0x7f7bec1f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7be3fff640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec0b2f70 0x7f7bec09da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 -- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bec06de90 msgr2=0x7f7bec1f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bec06de90 0x7f7bec1f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 -- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec0b2f70 msgr2=0x7f7bec09da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec0b2f70 0x7f7bec09da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.609+0000 7f7bead9d640 1 -- 172.21.15.57:0/1700296657 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec09b9d0 con 0x7f7bec15de60 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.610+0000 7f7bead9d640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec15afb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c7b0 tx=0x7f7be400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.610+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4003b70 con 0x7f7bec15de60 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.610+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec09f760 con 0x7f7bec15de60 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.610+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7be4003d30 con 0x7f7bec15de60 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.610+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be400aab0 con 0x7f7bec15de60 2024-09-10T11:38:30.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.610+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec1f5000 con 0x7f7bec15de60 2024-09-10T11:38:30.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.611+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec0ce320 con 0x7f7bec15de60 2024-09-10T11:38:30.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.612+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f7be400ac50 con 0x7f7bec15de60 2024-09-10T11:38:30.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.612+0000 7f7be2ffd640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bcc0750a0 0x7f7bcc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:30.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.612+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7be4095e40 con 0x7f7bec15de60 2024-09-10T11:38:30.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.613+0000 7f7bea59c640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bcc0750a0 0x7f7bcc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:30.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.613+0000 7f7bea59c640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bcc0750a0 0x7f7bcc077560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc033000 tx=0x7f7bdc004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:30.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.616+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f7bec09f760 con 0x7f7bec15de60 2024-09-10T11:38:30.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.798+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bec0d2950 con 0x7f7bec15de60 2024-09-10T11:38:30.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.798+0000 7f7be2ffd640 1 -- 172.21.15.57:0/1700296657 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f7be405fe20 con 0x7f7bec15de60 2024-09-10T11:38:30.799 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:30.799 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"btime":"2024-09-10T11:38:30:569869+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1163026307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1163026307},{"type":"v1","addr":"172.21.15.57:6834","nonce":1163026307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T11:38:30.800 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bcc0750a0 msgr2=0x7f7bcc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bcc0750a0 0x7f7bcc077560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc033000 tx=0x7f7bdc004730 comp rx=0 tx=0).stop 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 msgr2=0x7f7bec15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec15afb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c7b0 tx=0x7f7be400cc70 comp rx=0 tx=0).stop 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 shutdown_connections 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bcc0750a0 0x7f7bcc077560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bec15de60 0x7f7bec15afb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bec0b2f70 0x7f7bec09da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 --2- 172.21.15.57:0/1700296657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bec06de90 0x7f7bec1f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:30.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 >> 172.21.15.57:0/1700296657 conn(0x7f7bec09aa20 msgr2=0x7f7bec0aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:30.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 shutdown_connections 2024-09-10T11:38:30.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:30.800+0000 7f7bf0d24640 1 -- 172.21.15.57:0/1700296657 wait complete. 2024-09-10T11:38:32.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T11:38:32.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 -- 172.21.15.57:0/2555137860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8238003a50 msgr2=0x7f8238003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:32.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 --2- 172.21.15.57:0/2555137860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8238003a50 0x7f8238003e70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8248001690 tx=0x7f8238005830 comp rx=0 tx=0).stop 2024-09-10T11:38:32.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 -- 172.21.15.57:0/2555137860 shutdown_connections 2024-09-10T11:38:32.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 --2- 172.21.15.57:0/2555137860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8238003a50 0x7f8238003e70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:32.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 -- 172.21.15.57:0/2555137860 >> 172.21.15.57:0/2555137860 conn(0x7f824c09aa20 msgr2=0x7f824c09ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:32.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 -- 172.21.15.57:0/2555137860 shutdown_connections 2024-09-10T11:38:32.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.930+0000 7f825450e640 1 -- 172.21.15.57:0/2555137860 wait complete. 2024-09-10T11:38:32.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.932+0000 7f825450e640 1 Processor -- start 2024-09-10T11:38:32.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.932+0000 7f825450e640 1 -- start start 2024-09-10T11:38:32.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.932+0000 7f825450e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8238003a50 0x7f824c1f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:32.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.932+0000 7f825450e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 0x7f824c1f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f825450e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f824c158b70 0x7f824c0b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f825450e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0d01a0 con 0x7f824c1f5ce0 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f825450e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0d0020 con 0x7f8238003a50 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f825450e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f824c0cc8e0 con 0x7f824c158b70 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 0x7f824c1f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 0x7f824c1f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57010/0 (socket says 172.21.15.57:57010) 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 -- 172.21.15.57:0/959532328 learned_addr learned my addr 172.21.15.57:0/959532328 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 -- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f824c158b70 msgr2=0x7f824c0b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f824c158b70 0x7f824c0b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 -- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8238003a50 msgr2=0x7f824c1f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8238003a50 0x7f824c1f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 -- 172.21.15.57:0/959532328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c1f6ba0 con 0x7f824c1f5ce0 2024-09-10T11:38:32.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8251aa9640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 0x7f824c1f6660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f823c006680 tx=0x7f823c0066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:32.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c015020 con 0x7f824c1f5ce0 2024-09-10T11:38:32.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f823c011920 con 0x7f824c1f5ce0 2024-09-10T11:38:32.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c1f2e90 con 0x7f824c1f5ce0 2024-09-10T11:38:32.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c011d70 con 0x7f824c1f5ce0 2024-09-10T11:38:32.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.933+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c1f3450 con 0x7f824c1f5ce0 2024-09-10T11:38:32.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.934+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824c1f3650 con 0x7f824c1f5ce0 2024-09-10T11:38:32.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.935+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f823c018020 con 0x7f824c1f5ce0 2024-09-10T11:38:32.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.935+0000 7f8242ffd640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f82300750d0 0x7f8230077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:32.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.935+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f823c096c20 con 0x7f824c1f5ce0 2024-09-10T11:38:32.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.936+0000 7f82522aa640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f82300750d0 0x7f8230077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:32.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.937+0000 7f82522aa640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f82300750d0 0x7f8230077590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8248032000 tx=0x7f8248001120 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:32.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:32.939+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f823c01f020 con 0x7f824c1f5ce0 2024-09-10T11:38:33.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.123+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f824c0cce40 con 0x7f824c1f5ce0 2024-09-10T11:38:33.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.123+0000 7f8242ffd640 1 -- 172.21.15.57:0/959532328 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f824c1f6ba0 con 0x7f824c1f5ce0 2024-09-10T11:38:33.125 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:33.125 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"btime":"2024-09-10T11:38:31:571244+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1421680054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1421680054},{"type":"v1","addr":"172.21.15.154:6836","nonce":1421680054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2099486363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2099486363},{"type":"v1","addr":"172.21.15.154:6837","nonce":2099486363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1163026307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1163026307},{"type":"v1","addr":"172.21.15.57:6834","nonce":1163026307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4368,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/470389392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":470389392},{"type":"v1","addr":"172.21.15.57:6835","nonce":470389392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T11:38:33.125 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f82300750d0 msgr2=0x7f8230077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f82300750d0 0x7f8230077590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8248032000 tx=0x7f8248001120 comp rx=0 tx=0).stop 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 msgr2=0x7f824c1f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 0x7f824c1f6660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f823c006680 tx=0x7f823c0066b0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 shutdown_connections 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f82300750d0 0x7f8230077590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f824c158b70 0x7f824c0b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f824c1f5ce0 0x7f824c1f6660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 --2- 172.21.15.57:0/959532328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8238003a50 0x7f824c1f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 >> 172.21.15.57:0/959532328 conn(0x7f824c09aa20 msgr2=0x7f824c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:33.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.125+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 shutdown_connections 2024-09-10T11:38:33.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.126+0000 7f825450e640 1 -- 172.21.15.57:0/959532328 wait complete. 2024-09-10T11:38:33.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 -- 172.21.15.57:0/323412502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b741612a0 msgr2=0x7f0b740d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 --2- 172.21.15.57:0/323412502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b741612a0 0x7f0b740d1900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b740b52d0 tx=0x7f0b6402a560 comp rx=0 tx=0).stop 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 -- 172.21.15.57:0/323412502 shutdown_connections 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 --2- 172.21.15.57:0/323412502 >> v2:172.21.15.154:3300/0 conn(0x7f0b740d4820 0x7f0b740cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 --2- 172.21.15.57:0/323412502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b741612a0 0x7f0b740d1900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 -- 172.21.15.57:0/323412502 >> 172.21.15.57:0/323412502 conn(0x7f0b7409cfe0 msgr2=0x7f0b740d3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 -- 172.21.15.57:0/323412502 shutdown_connections 2024-09-10T11:38:33.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.241+0000 7f0b79794640 1 -- 172.21.15.57:0/323412502 wait complete. 2024-09-10T11:38:33.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.242+0000 7f0b79794640 1 Processor -- start 2024-09-10T11:38:33.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.242+0000 7f0b79794640 1 -- start start 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b79794640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b740b49a0 0x7f0b740cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b79794640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 0x7f0b74152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b79794640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b741612a0 0x7f0b740b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b79794640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740b3690 con 0x7f0b740d4820 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b79794640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740b3510 con 0x7f0b740b49a0 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b79794640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740b3810 con 0x7f0b741612a0 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 0x7f0b74152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 0x7f0b74152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57028/0 (socket says 172.21.15.57:57028) 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 -- 172.21.15.57:0/663837805 learned_addr learned my addr 172.21.15.57:0/663837805 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:33.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b72ffd640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b740b49a0 0x7f0b740cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b737fe640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b741612a0 0x7f0b740b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 -- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b741612a0 msgr2=0x7f0b740b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b741612a0 0x7f0b740b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 -- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b740b49a0 msgr2=0x7f0b740cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b740b49a0 0x7f0b740cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 -- 172.21.15.57:0/663837805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b740cae00 con 0x7f0b740d4820 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b737fe640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b741612a0 0x7f0b740b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.243+0000 7f0b727fc640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 0x7f0b74152080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c410 tx=0x7f0b6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.244+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68017070 con 0x7f0b740d4820 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.244+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b680035f0 con 0x7f0b740d4820 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.244+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b740cb0e0 con 0x7f0b740d4820 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.244+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68003a80 con 0x7f0b740d4820 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.244+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741f8660 con 0x7f0b740d4820 2024-09-10T11:38:33.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.245+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b740743d0 con 0x7f0b740d4820 2024-09-10T11:38:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.245+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0b6801a070 con 0x7f0b740d4820 2024-09-10T11:38:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.246+0000 7f0b5b7fe640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b600750a0 0x7f0b60077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.246+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0b68095310 con 0x7f0b740d4820 2024-09-10T11:38:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.246+0000 7f0b72ffd640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b600750a0 0x7f0b60077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.246+0000 7f0b72ffd640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b600750a0 0x7f0b60077560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b64033000 tx=0x7f0b64004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:33.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.250+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f0b740743d0 con 0x7f0b740d4820 2024-09-10T11:38:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.411+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0b740b3d20 con 0x7f0b740d4820 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.412+0000 7f0b5b7fe640 1 -- 172.21.15.57:0/663837805 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f0b6805fa50 con 0x7f0b740d4820 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2024-09-10T11:38:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-09-10T11:38:33.414 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b600750a0 msgr2=0x7f0b60077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b600750a0 0x7f0b60077560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b64033000 tx=0x7f0b64004730 comp rx=0 tx=0).stop 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 msgr2=0x7f0b74152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 0x7f0b74152080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c410 tx=0x7f0b6800c8d0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 shutdown_connections 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b600750a0 0x7f0b60077560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b741612a0 0x7f0b740b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b740d4820 0x7f0b74152080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 --2- 172.21.15.57:0/663837805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b740b49a0 0x7f0b740cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 >> 172.21.15.57:0/663837805 conn(0x7f0b7409cfe0 msgr2=0x7f0b7415f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 shutdown_connections 2024-09-10T11:38:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.414+0000 7f0b79794640 1 -- 172.21.15.57:0/663837805 wait complete. 2024-09-10T11:38:33.425 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T11:38:33.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T11:38:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 -- 172.21.15.57:0/3910883486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 msgr2=0x7f60c40d2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 --2- 172.21.15.57:0/3910883486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 0x7f60c40d2930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009830 tx=0x7f60b402a540 comp rx=0 tx=0).stop 2024-09-10T11:38:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 -- 172.21.15.57:0/3910883486 shutdown_connections 2024-09-10T11:38:33.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 --2- 172.21.15.57:0/3910883486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 0x7f60c40d2930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 -- 172.21.15.57:0/3910883486 >> 172.21.15.57:0/3910883486 conn(0x7f60c409d050 msgr2=0x7f60c40d3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 -- 172.21.15.57:0/3910883486 shutdown_connections 2024-09-10T11:38:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.534+0000 7f60c8f64640 1 -- 172.21.15.57:0/3910883486 wait complete. 2024-09-10T11:38:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.535+0000 7f60c8f64640 1 Processor -- start 2024-09-10T11:38:33.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.535+0000 7f60c8f64640 1 -- start start 2024-09-10T11:38:33.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c8f64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 0x7f60c4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c8f64640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c40cf7f0 0x7f60c40b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c8f64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 0x7f60c40b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c8f64640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40b4960 con 0x7f60c40b57e0 2024-09-10T11:38:33.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c8f64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40b6750 con 0x7f60c4161360 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c8f64640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60c40b4ae0 con 0x7f60c40cf7f0 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 0x7f60c4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 0x7f60c4155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57034/0 (socket says 172.21.15.57:57034) 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c259c640 1 -- 172.21.15.57:0/1313314040 learned_addr learned my addr 172.21.15.57:0/1313314040 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.536+0000 7f60c2d9d640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 0x7f60c40b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c1d9b640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c40cf7f0 0x7f60c40b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c259c640 1 -- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c40cf7f0 msgr2=0x7f60c40b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c259c640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c40cf7f0 0x7f60c40b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c259c640 1 -- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 msgr2=0x7f60c40b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c259c640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 0x7f60c40b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c259c640 1 -- 172.21.15.57:0/1313314040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c41f4970 con 0x7f60c40b57e0 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c1d9b640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c40cf7f0 0x7f60c40b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c259c640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 0x7f60c4155210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009950 tx=0x7f60b4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:33.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4005c90 con 0x7f60c40b57e0 2024-09-10T11:38:33.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60b4005020 con 0x7f60c40b57e0 2024-09-10T11:38:33.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c41f4c50 con 0x7f60c40b57e0 2024-09-10T11:38:33.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4005450 con 0x7f60c40b57e0 2024-09-10T11:38:33.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.537+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c4155750 con 0x7f60c40b57e0 2024-09-10T11:38:33.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.538+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c40b5ed0 con 0x7f60c40b57e0 2024-09-10T11:38:33.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.539+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f60b40317c0 con 0x7f60c40b57e0 2024-09-10T11:38:33.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.539+0000 7f60b2ffd640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a40750d0 0x7f60a4077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:33.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.539+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f60b40b6e40 con 0x7f60c40b57e0 2024-09-10T11:38:33.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.539+0000 7f60c1d9b640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a40750d0 0x7f60a4077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:33.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.540+0000 7f60c1d9b640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a40750d0 0x7f60a4077590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60c40d4220 tx=0x7f60b8009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:33.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.543+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f60b403f030 con 0x7f60c40b57e0 2024-09-10T11:38:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:33.705+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f60c415fbd0 con 0x7f60c40b57e0 2024-09-10T11:38:34.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.609+0000 7f60b2ffd640 1 -- 172.21.15.57:0/1313314040 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f60b4080ea0 con 0x7f60c40b57e0 2024-09-10T11:38:34.610 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-09-10T11:38:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a40750d0 msgr2=0x7f60a4077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a40750d0 0x7f60a4077590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60c40d4220 tx=0x7f60b8009040 comp rx=0 tx=0).stop 2024-09-10T11:38:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 msgr2=0x7f60c4155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 0x7f60c4155210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009950 tx=0x7f60b4003c10 comp rx=0 tx=0).stop 2024-09-10T11:38:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 shutdown_connections 2024-09-10T11:38:34.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a40750d0 0x7f60a4077590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c4161360 0x7f60c40b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c40cf7f0 0x7f60c40b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 --2- 172.21.15.57:0/1313314040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c40b57e0 0x7f60c4155210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 >> 172.21.15.57:0/1313314040 conn(0x7f60c409d050 msgr2=0x7f60c40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 shutdown_connections 2024-09-10T11:38:34.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.612+0000 7f60c8f64640 1 -- 172.21.15.57:0/1313314040 wait complete. 2024-09-10T11:38:34.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T11:38:34.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 -- 172.21.15.57:0/4225783170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 msgr2=0x7f94e40cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 --2- 172.21.15.57:0/4225783170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cee40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005fd0 tx=0x7f94dc02a4b0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 -- 172.21.15.57:0/4225783170 shutdown_connections 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 --2- 172.21.15.57:0/4225783170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e40d0d40 0x7f94e40ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 --2- 172.21.15.57:0/4225783170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cee40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 -- 172.21.15.57:0/4225783170 >> 172.21.15.57:0/4225783170 conn(0x7f94e40d3e10 msgr2=0x7f94e40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 -- 172.21.15.57:0/4225783170 shutdown_connections 2024-09-10T11:38:34.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.747+0000 7f94eab90640 1 -- 172.21.15.57:0/4225783170 wait complete. 2024-09-10T11:38:34.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.748+0000 7f94eab90640 1 Processor -- start 2024-09-10T11:38:34.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.748+0000 7f94eab90640 1 -- start start 2024-09-10T11:38:34.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94eab90640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94eab90640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e40d0d40 0x7f94e415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94eab90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4161410 0x7f94e41f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94eab90640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f94e40b5780 con 0x7f94e40c8ab0 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94eab90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94e40b5600 con 0x7f94e4161410 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94eab90640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f94e40cf380 con 0x7f94e40d0d40 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94e892c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94e892c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57060/0 (socket says 172.21.15.57:57060) 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.749+0000 7f94e892c640 1 -- 172.21.15.57:0/1442631369 learned_addr learned my addr 172.21.15.57:0/1442631369 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e3fff640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e40d0d40 0x7f94e415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e912d640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4161410 0x7f94e41f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e892c640 1 -- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e40d0d40 msgr2=0x7f94e415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e892c640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e40d0d40 0x7f94e415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e892c640 1 -- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4161410 msgr2=0x7f94e41f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e892c640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4161410 0x7f94e41f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e892c640 1 -- 172.21.15.57:0/1442631369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e41f51f0 con 0x7f94e40c8ab0 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e892c640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cb9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c340 tx=0x7f94d400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4017070 con 0x7f94e40c8ab0 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d40053c0 con 0x7f94e40c8ab0 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4003850 con 0x7f94e40c8ab0 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e41f5530 con 0x7f94e40c8ab0 2024-09-10T11:38:34.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.750+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e40cb4a0 con 0x7f94e40c8ab0 2024-09-10T11:38:34.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.751+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e40cf7d0 con 0x7f94e40c8ab0 2024-09-10T11:38:34.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.752+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f94d401a070 con 0x7f94e40c8ab0 2024-09-10T11:38:34.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.752+0000 7f94e17fa640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f94c40750a0 0x7f94c4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:34.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.752+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f94d4095490 con 0x7f94e40c8ab0 2024-09-10T11:38:34.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.753+0000 7f94e3fff640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f94c40750a0 0x7f94c4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:34.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.753+0000 7f94e3fff640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f94c40750a0 0x7f94c4077560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94e40c85f0 tx=0x7f94cc00a590 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:34.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.757+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f94e41f5530 con 0x7f94e40c8ab0 2024-09-10T11:38:34.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:34.916+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f94e40d3260 con 0x7f94e40c8ab0 2024-09-10T11:38:35.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.618+0000 7f94e17fa640 1 -- 172.21.15.57:0/1442631369 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f94d405f380 con 0x7f94e40c8ab0 2024-09-10T11:38:35.619 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f94c40750a0 msgr2=0x7f94c4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f94c40750a0 0x7f94c4077560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94e40c85f0 tx=0x7f94cc00a590 comp rx=0 tx=0).stop 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 msgr2=0x7f94e40cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cb9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c340 tx=0x7f94d400c800 comp rx=0 tx=0).stop 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 shutdown_connections 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f94c40750a0 0x7f94c4077560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4161410 0x7f94e41f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e40d0d40 0x7f94e415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 --2- 172.21.15.57:0/1442631369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94e40c8ab0 0x7f94e40cb9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:35.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 >> 172.21.15.57:0/1442631369 conn(0x7f94e40d3e10 msgr2=0x7f94e40ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 shutdown_connections 2024-09-10T11:38:35.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.621+0000 7f94eab90640 1 -- 172.21.15.57:0/1442631369 wait complete. 2024-09-10T11:38:35.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T11:38:35.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c1d983640 1 -- 172.21.15.57:0/2388879901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 msgr2=0x7f6c00004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c1d983640 1 --2- 172.21.15.57:0/2388879901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c00004800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c290 tx=0x7f6c00005830 comp rx=0 tx=0).stop 2024-09-10T11:38:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c177fe640 1 -- 172.21.15.57:0/2388879901 reap_dead start 2024-09-10T11:38:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c1d983640 1 -- 172.21.15.57:0/2388879901 shutdown_connections 2024-09-10T11:38:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c1d983640 1 -- 172.21.15.57:0/2388879901 >> 172.21.15.57:0/2388879901 conn(0x7f6c180d3d00 msgr2=0x7f6c180d4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c1d983640 1 -- 172.21.15.57:0/2388879901 shutdown_connections 2024-09-10T11:38:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.760+0000 7f6c1d983640 1 -- 172.21.15.57:0/2388879901 wait complete. 2024-09-10T11:38:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.762+0000 7f6c1d983640 1 Processor -- start 2024-09-10T11:38:35.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.762+0000 7f6c1d983640 1 -- start start 2024-09-10T11:38:35.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.762+0000 7f6c1d983640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c181f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.762+0000 7f6c1d983640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c180b9340 0x7f6c180b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c1d983640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c180b7c80 0x7f6c181538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c1d983640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d2610 con 0x7f6c00003fd0 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c1d983640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180cfa80 con 0x7f6c180b7c80 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c1d983640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180d2790 con 0x7f6c180b9340 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c181f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c181f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57074/0 (socket says 172.21.15.57:57074) 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 -- 172.21.15.57:0/3149112947 learned_addr learned my addr 172.21.15.57:0/3149112947 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c177fe640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c180b7c80 0x7f6c181538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c167fc640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c180b9340 0x7f6c180b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 -- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c180b9340 msgr2=0x7f6c180b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:35.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c180b9340 0x7f6c180b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 -- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c180b7c80 msgr2=0x7f6c181538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c180b7c80 0x7f6c181538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 -- 172.21.15.57:0/3149112947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180b9890 con 0x7f6c00003fd0 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c16ffd640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c181f5080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c08011ae0 tx=0x7f6c08009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801e070 con 0x7f6c00003fd0 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c0800fe70 con 0x7f6c00003fd0 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c180b6c60 con 0x7f6c00003fd0 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08004290 con 0x7f6c00003fd0 2024-09-10T11:38:35.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.763+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180b7220 con 0x7f6c00003fd0 2024-09-10T11:38:35.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.764+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c180b4bc0 con 0x7f6c00003fd0 2024-09-10T11:38:35.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.765+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f6c08021070 con 0x7f6c00003fd0 2024-09-10T11:38:35.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.766+0000 7f6bfffff640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c040750d0 0x7f6c04077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:35.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.766+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f6c08096b70 con 0x7f6c00003fd0 2024-09-10T11:38:35.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.766+0000 7f6c167fc640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c040750d0 0x7f6c04077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:35.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.766+0000 7f6c167fc640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c040750d0 0x7f6c04077590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c033000 tx=0x7f6c180ce6f0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:35.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.770+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f6c08060a30 con 0x7f6c00003fd0 2024-09-10T11:38:35.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:35.953+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6c180cdab0 con 0x7f6c00003fd0 2024-09-10T11:38:36.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.630+0000 7f6bfffff640 1 -- 172.21.15.57:0/3149112947 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6c080651f0 con 0x7f6c00003fd0 2024-09-10T11:38:36.635 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T11:38:36.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.641+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c040750d0 msgr2=0x7f6c04077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.641+0000 7f6c1d983640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c040750d0 0x7f6c04077590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c033000 tx=0x7f6c180ce6f0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.641+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 msgr2=0x7f6c181f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.641+0000 7f6c1d983640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c181f5080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c08011ae0 tx=0x7f6c08009e90 comp rx=0 tx=0).stop 2024-09-10T11:38:36.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.644+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 shutdown_connections 2024-09-10T11:38:36.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.644+0000 7f6c1d983640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c040750d0 0x7f6c04077590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.644+0000 7f6c1d983640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c180b7c80 0x7f6c181538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.644+0000 7f6c1d983640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c180b9340 0x7f6c180b7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.644+0000 7f6c1d983640 1 --2- 172.21.15.57:0/3149112947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c00003fd0 0x7f6c181f5080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.644+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 >> 172.21.15.57:0/3149112947 conn(0x7f6c180d3d00 msgr2=0x7f6c181ea3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:36.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.648+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 shutdown_connections 2024-09-10T11:38:36.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.648+0000 7f6c1d983640 1 -- 172.21.15.57:0/3149112947 wait complete. 2024-09-10T11:38:36.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 -- 172.21.15.57:0/2254619791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 msgr2=0x7f9870004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 --2- 172.21.15.57:0/2254619791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f9870004c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f987400c310 tx=0x7f9870005830 comp rx=0 tx=0).stop 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 -- 172.21.15.57:0/2254619791 shutdown_connections 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 --2- 172.21.15.57:0/2254619791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f9870004c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 -- 172.21.15.57:0/2254619791 >> 172.21.15.57:0/2254619791 conn(0x7f988409cf80 msgr2=0x7f98840d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 -- 172.21.15.57:0/2254619791 shutdown_connections 2024-09-10T11:38:36.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.776+0000 7f988b657640 1 -- 172.21.15.57:0/2254619791 wait complete. 2024-09-10T11:38:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.777+0000 7f988b657640 1 Processor -- start 2024-09-10T11:38:36.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.777+0000 7f988b657640 1 -- start start 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f988b657640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f988415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f988b657640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884160db0 0x7f98840ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f988b657640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98840cd510 0x7f98841f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f988b657640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d24a0 con 0x7f9870004800 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f988b657640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98840d1ed0 con 0x7f9884160db0 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f988b657640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f98840d2620 con 0x7f98840cd510 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f988415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:36.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f988415ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57102/0 (socket says 172.21.15.57:57102) 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 -- 172.21.15.57:0/3109272012 learned_addr learned my addr 172.21.15.57:0/3109272012 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f9888bf2640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884160db0 0x7f98840ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f9889bf4640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98840cd510 0x7f98841f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 -- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98840cd510 msgr2=0x7f98841f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98840cd510 0x7f98841f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 -- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884160db0 msgr2=0x7f98840ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884160db0 0x7f98840ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 -- 172.21.15.57:0/3109272012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98841f5740 con 0x7f9870004800 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.778+0000 7f98893f3640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f988415ef10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9880004d60 tx=0x7f9880001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.779+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880017070 con 0x7f9870004800 2024-09-10T11:38:36.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.779+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9880004e50 con 0x7f9870004800 2024-09-10T11:38:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.779+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988415f450 con 0x7f9870004800 2024-09-10T11:38:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.779+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880010b00 con 0x7f9870004800 2024-09-10T11:38:36.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.779+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988415e430 con 0x7f9870004800 2024-09-10T11:38:36.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.780+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884161a10 con 0x7f9870004800 2024-09-10T11:38:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.780+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f988001a070 con 0x7f9870004800 2024-09-10T11:38:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.781+0000 7f9879ffb640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f98680750d0 0x7f9868077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.781+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9880096010 con 0x7f9870004800 2024-09-10T11:38:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.781+0000 7f9888bf2640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f98680750d0 0x7f9868077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.782+0000 7f9888bf2640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f98680750d0 0x7f9868077590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9874033000 tx=0x7f9874038040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:36.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.785+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f988005fd20 con 0x7f9870004800 2024-09-10T11:38:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.949+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f988406e3a0 con 0x7f9870004800 2024-09-10T11:38:36.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.950+0000 7f9879ffb640 1 -- 172.21.15.57:0/3109272012 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16690 (secure 0 0 0) 0x7f98800644e0 con 0x7f9870004800 2024-09-10T11:38:36.951 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:36.951 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:35.954803+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:38:33.708684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:38:34.920262+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f98680750d0 msgr2=0x7f9868077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f98680750d0 0x7f9868077590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9874033000 tx=0x7f9874038040 comp rx=0 tx=0).stop 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 msgr2=0x7f988415ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f988415ef10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9880004d60 tx=0x7f9880001630 comp rx=0 tx=0).stop 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 shutdown_connections 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f98680750d0 0x7f9868077590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98840cd510 0x7f98841f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884160db0 0x7f98840ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 --2- 172.21.15.57:0/3109272012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9870004800 0x7f988415ef10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 >> 172.21.15.57:0/3109272012 conn(0x7f988409cf80 msgr2=0x7f98840b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.951+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 shutdown_connections 2024-09-10T11:38:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:36.952+0000 7f988b657640 1 -- 172.21.15.57:0/3109272012 wait complete. 2024-09-10T11:38:36.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 -- 172.21.15.57:0/3904277800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c015e040 msgr2=0x7f55c00d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 --2- 172.21.15.57:0/3904277800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c015e040 0x7f55c00d29e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55c00695f0 tx=0x7f55b802ab40 comp rx=0 tx=0).stop 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 -- 172.21.15.57:0/3904277800 shutdown_connections 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 --2- 172.21.15.57:0/3904277800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c015e040 0x7f55c00d29e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 --2- 172.21.15.57:0/3904277800 >> v2:172.21.15.154:3300/0 conn(0x7f55c015dc60 0x7f55c00d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 -- 172.21.15.57:0/3904277800 >> 172.21.15.57:0/3904277800 conn(0x7f55c009cf80 msgr2=0x7f55c00d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 -- 172.21.15.57:0/3904277800 shutdown_connections 2024-09-10T11:38:37.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.068+0000 7f55c73f8640 1 -- 172.21.15.57:0/3904277800 wait complete. 2024-09-10T11:38:37.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.069+0000 7f55c73f8640 1 Processor -- start 2024-09-10T11:38:37.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.069+0000 7f55c73f8640 1 -- start start 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 0x7f55c0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c015dc60 0x7f55c00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55c015e040 0x7f55c00b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f55c00d1e40 con 0x7f55c00d45b0 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55c00d1cc0 con 0x7f55c015dc60 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f55c00d1fc0 con 0x7f55c015e040 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 0x7f55c0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 0x7f55c0153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57122/0 (socket says 172.21.15.57:57122) 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 -- 172.21.15.57:0/4263816360 learned_addr learned my addr 172.21.15.57:0/4263816360 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c4993640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c015dc60 0x7f55c00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5995640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55c015e040 0x7f55c00b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 -- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55c015e040 msgr2=0x7f55c00b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55c015e040 0x7f55c00b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 -- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c015dc60 msgr2=0x7f55c00b8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c015dc60 0x7f55c00b8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 -- 172.21.15.57:0/4263816360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c0158d20 con 0x7f55c00d45b0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5995640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55c015e040 0x7f55c00b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c5194640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 0x7f55c0153fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00d980 tx=0x7f55bc00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc017070 con 0x7f55c00d45b0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55bc009d20 con 0x7f55c00d45b0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0106c0 con 0x7f55c00d45b0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.070+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c0160cb0 con 0x7f55c00d45b0 2024-09-10T11:38:37.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.071+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c01592c0 con 0x7f55c00d45b0 2024-09-10T11:38:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.072+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c0162430 con 0x7f55c00d45b0 2024-09-10T11:38:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.072+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f55bc010860 con 0x7f55c00d45b0 2024-09-10T11:38:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.073+0000 7f55b5ffb640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55a40750a0 0x7f55a4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.073+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55bc096770 con 0x7f55c00d45b0 2024-09-10T11:38:37.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.073+0000 7f55c4993640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55a40750a0 0x7f55a4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.073+0000 7f55c4993640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55a40750a0 0x7f55a4077560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000f60 tx=0x7f55b0009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:37.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.077+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f55bc060ac0 con 0x7f55c00d45b0 2024-09-10T11:38:37.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.238+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55c0157a70 con 0x7f55c00d45b0 2024-09-10T11:38:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.239+0000 7f55b5ffb640 1 -- 172.21.15.57:0/4263816360 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16690 (secure 0 0 0) 0x7f55bc0603c0 con 0x7f55c00d45b0 2024-09-10T11:38:37.241 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:37.241 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:35.954803+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:38:33.708684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:38:34.920262+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55a40750a0 msgr2=0x7f55a4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55a40750a0 0x7f55a4077560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000f60 tx=0x7f55b0009040 comp rx=0 tx=0).stop 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 msgr2=0x7f55c0153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 0x7f55c0153fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00d980 tx=0x7f55bc00de40 comp rx=0 tx=0).stop 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 shutdown_connections 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55a40750a0 0x7f55a4077560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55c015e040 0x7f55c00b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55c015dc60 0x7f55c00b8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 --2- 172.21.15.57:0/4263816360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c00d45b0 0x7f55c0153fa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 >> 172.21.15.57:0/4263816360 conn(0x7f55c009cf80 msgr2=0x7f55c006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.241+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 shutdown_connections 2024-09-10T11:38:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.242+0000 7f55c73f8640 1 -- 172.21.15.57:0/4263816360 wait complete. 2024-09-10T11:38:37.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T11:38:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 -- 172.21.15.57:0/1160195341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d80741e0 msgr2=0x7fa8d80732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 --2- 172.21.15.57:0/1160195341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d80741e0 0x7fa8d80732e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009890 tx=0x7fa8c002a560 comp rx=0 tx=0).stop 2024-09-10T11:38:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 -- 172.21.15.57:0/1160195341 shutdown_connections 2024-09-10T11:38:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 --2- 172.21.15.57:0/1160195341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d80741e0 0x7fa8d80732e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 -- 172.21.15.57:0/1160195341 >> 172.21.15.57:0/1160195341 conn(0x7fa8d80d0a40 msgr2=0x7fa8d80d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:37.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 -- 172.21.15.57:0/1160195341 shutdown_connections 2024-09-10T11:38:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.360+0000 7fa8dc849640 1 -- 172.21.15.57:0/1160195341 wait complete. 2024-09-10T11:38:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.361+0000 7fa8dc849640 1 Processor -- start 2024-09-10T11:38:37.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.361+0000 7fa8dc849640 1 -- start start 2024-09-10T11:38:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8dc849640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8073820 0x7fa8d8144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8dc849640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 0x7fa8d81f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8dc849640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d8154f30 0x7fa8d8144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8dc849640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8165ee0 con 0x7fa8d80741e0 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8dc849640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8165d60 con 0x7fa8d8073820 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8dc849640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d8166060 con 0x7fa8d8154f30 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 0x7fa8d81f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 0x7fa8d81f7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57138/0 (socket says 172.21.15.57:57138) 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 -- 172.21.15.57:0/4057516215 learned_addr learned my addr 172.21.15.57:0/4057516215 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d6d9d640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d8154f30 0x7fa8d8144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d659c640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8073820 0x7fa8d8144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 -- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d8154f30 msgr2=0x7fa8d8144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d8154f30 0x7fa8d8144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 -- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8073820 msgr2=0x7fa8d8144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8073820 0x7fa8d8144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.362+0000 7fa8d5d9b640 1 -- 172.21.15.57:0/4057516215 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d8150e10 con 0x7fa8d80741e0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.363+0000 7fa8d5d9b640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 0x7fa8d81f7ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00099b0 tx=0x7fa8c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.363+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0005c90 con 0x7fa8d80741e0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.363+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c0005350 con 0x7fa8d80741e0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.363+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d81510f0 con 0x7fa8d80741e0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.363+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00047a0 con 0x7fa8d80741e0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.363+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d8148110 con 0x7fa8d80741e0 2024-09-10T11:38:37.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.364+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d80732e0 con 0x7fa8d80741e0 2024-09-10T11:38:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.364+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa8c0039040 con 0x7fa8d80741e0 2024-09-10T11:38:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.365+0000 7fa8ceffd640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8b80750a0 0x7fa8b8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.365+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa8c00b7170 con 0x7fa8d80741e0 2024-09-10T11:38:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.365+0000 7fa8d659c640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8b80750a0 0x7fa8b8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.366+0000 7fa8d659c640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8b80750a0 0x7fa8b8077560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00017a0 tx=0x7fa8d0001730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:37.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.369+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fa8c0040030 con 0x7fa8d80741e0 2024-09-10T11:38:37.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.552+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa8d80d1810 con 0x7fa8d80741e0 2024-09-10T11:38:37.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.638+0000 7fa8ceffd640 1 -- 172.21.15.57:0/4057516215 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fa8c0080f10 con 0x7fa8d80741e0 2024-09-10T11:38:37.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8b80750a0 msgr2=0x7fa8b8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8b80750a0 0x7fa8b8077560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00017a0 tx=0x7fa8d0001730 comp rx=0 tx=0).stop 2024-09-10T11:38:37.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 msgr2=0x7fa8d81f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 0x7fa8d81f7ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00099b0 tx=0x7fa8c0003c10 comp rx=0 tx=0).stop 2024-09-10T11:38:37.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 shutdown_connections 2024-09-10T11:38:37.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8b80750a0 0x7fa8b8077560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8d8154f30 0x7fa8d8144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8d80741e0 0x7fa8d81f7ab0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 --2- 172.21.15.57:0/4057516215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8d8073820 0x7fa8d8144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 >> 172.21.15.57:0/4057516215 conn(0x7fa8d80d0a40 msgr2=0x7fa8d806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:37.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 shutdown_connections 2024-09-10T11:38:37.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.640+0000 7fa8dc849640 1 -- 172.21.15.57:0/4057516215 wait complete. 2024-09-10T11:38:37.652 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T11:38:37.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T11:38:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.758+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/2146385387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80b2b20 msgr2=0x7f9bc815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.758+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/2146385387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80b2b20 0x7f9bc815fa40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80b2f40 tx=0x7f9bb002a4d0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/2146385387 shutdown_connections 2024-09-10T11:38:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/2146385387 >> v2:172.21.15.154:3300/0 conn(0x7f9bc80d0580 0x7f9bc815ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/2146385387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80b2b20 0x7f9bc815fa40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/2146385387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80cfc60 0x7f9bc80d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/2146385387 >> 172.21.15.57:0/2146385387 conn(0x7f9bc80d1af0 msgr2=0x7f9bc80d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:37.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/2146385387 shutdown_connections 2024-09-10T11:38:37.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.759+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/2146385387 wait complete. 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.760+0000 7f9bcd1d1640 1 Processor -- start 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.760+0000 7f9bcd1d1640 1 -- start start 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bcd1d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80b2b20 0x7f9bc81f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bcd1d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 0x7f9bc806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bcd1d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc80d0580 0x7f9bc806f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bcd1d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80b17e0 con 0x7f9bc80cfc60 2024-09-10T11:38:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bcd1d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80b1660 con 0x7f9bc80d0580 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bcd1d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc80b1960 con 0x7f9bc80b2b20 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 0x7f9bc806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 0x7f9bc806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57156/0 (socket says 172.21.15.57:57156) 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 -- 172.21.15.57:0/1309124998 learned_addr learned my addr 172.21.15.57:0/1309124998 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc759e640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc80d0580 0x7f9bc806f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc6d9d640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80b2b20 0x7f9bc81f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 -- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80b2b20 msgr2=0x7f9bc81f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80b2b20 0x7f9bc81f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 -- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc80d0580 msgr2=0x7f9bc806f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:37.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc80d0580 0x7f9bc806f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc659c640 1 -- 172.21.15.57:0/1309124998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc806e150 con 0x7f9bc80cfc60 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.761+0000 7f9bc6d9d640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80b2b20 0x7f9bc81f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.762+0000 7f9bc659c640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 0x7f9bc806d9e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.762+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb003f070 con 0x7f9bc80cfc60 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.762+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bb0004890 con 0x7f9bc80cfc60 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.762+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc806e430 con 0x7f9bc80cfc60 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.762+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0035030 con 0x7f9bc80cfc60 2024-09-10T11:38:37.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.762+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc806e9f0 con 0x7f9bc80cfc60 2024-09-10T11:38:37.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.763+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc80d0040 con 0x7f9bc80cfc60 2024-09-10T11:38:37.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.763+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f9bb0042070 con 0x7f9bc80cfc60 2024-09-10T11:38:37.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.764+0000 7f9bbf7fe640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9ba80750a0 0x7f9ba8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:37.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.764+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9bb00b7260 con 0x7f9bc80cfc60 2024-09-10T11:38:37.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.764+0000 7f9bc6d9d640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9ba80750a0 0x7f9ba8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:37.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.765+0000 7f9bc6d9d640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9ba80750a0 0x7f9ba8077560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8071ca0 tx=0x7f9bb8005ed0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:37.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.768+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f9bb0080ed0 con 0x7f9bc80cfc60 2024-09-10T11:38:37.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:37.957+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9bc80d20e0 con 0x7f9bc80cfc60 2024-09-10T11:38:38.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.643+0000 7f9bbf7fe640 1 -- 172.21.15.57:0/1309124998 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f9bb0085690 con 0x7f9bc80cfc60 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9ba80750a0 msgr2=0x7f9ba8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9ba80750a0 0x7f9ba8077560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8071ca0 tx=0x7f9bb8005ed0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 msgr2=0x7f9bc806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 0x7f9bc806d9e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb00039e0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 shutdown_connections 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9ba80750a0 0x7f9ba8077560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc80d0580 0x7f9bc806f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bc80cfc60 0x7f9bc806d9e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 --2- 172.21.15.57:0/1309124998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc80b2b20 0x7f9bc81f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 >> 172.21.15.57:0/1309124998 conn(0x7f9bc80d1af0 msgr2=0x7f9bc80afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 shutdown_connections 2024-09-10T11:38:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.645+0000 7f9bcd1d1640 1 -- 172.21.15.57:0/1309124998 wait complete. 2024-09-10T11:38:38.657 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T11:38:38.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42eb5e2640 1 -- 172.21.15.57:0/2573904095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 msgr2=0x7f42cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/2573904095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42cc0051c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42d4001f30 tx=0x7f42cc005830 comp rx=0 tx=0).stop 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42e9b7f640 1 -- 172.21.15.57:0/2573904095 reap_dead start 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42eb5e2640 1 -- 172.21.15.57:0/2573904095 shutdown_connections 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42eb5e2640 1 -- 172.21.15.57:0/2573904095 >> 172.21.15.57:0/2573904095 conn(0x7f42e406ccf0 msgr2=0x7f42e406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42eb5e2640 1 -- 172.21.15.57:0/2573904095 shutdown_connections 2024-09-10T11:38:38.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.764+0000 7f42eb5e2640 1 -- 172.21.15.57:0/2573904095 wait complete. 2024-09-10T11:38:38.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.765+0000 7f42eb5e2640 1 Processor -- start 2024-09-10T11:38:38.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.765+0000 7f42eb5e2640 1 -- start start 2024-09-10T11:38:38.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42e4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:38.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e4156130 0x7f42e41f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:38.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e41f6070 0x7f42e41f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:38.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40af2e0 con 0x7f42cc004d40 2024-09-10T11:38:38.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40af160 con 0x7f42e4156130 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f42e40cc840 con 0x7f42e41f6070 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42e4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42e4152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57174/0 (socket says 172.21.15.57:57174) 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 -- 172.21.15.57:0/956783831 learned_addr learned my addr 172.21.15.57:0/956783831 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e8b7d640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e4156130 0x7f42e41f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e9b7f640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e41f6070 0x7f42e41f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 -- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e41f6070 msgr2=0x7f42e41f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e41f6070 0x7f42e41f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 -- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e4156130 msgr2=0x7f42e41f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e4156130 0x7f42e41f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 -- 172.21.15.57:0/956783831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e415d130 con 0x7f42cc004d40 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e9b7f640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e41f6070 0x7f42e41f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:38.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e937e640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42e4152bb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42dc011b10 tx=0x7f42dc009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc01e070 con 0x7f42cc004d40 2024-09-10T11:38:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42dc004050 con 0x7f42cc004d40 2024-09-10T11:38:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.766+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e415d410 con 0x7f42cc004d40 2024-09-10T11:38:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.767+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00fea0 con 0x7f42cc004d40 2024-09-10T11:38:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.767+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e415d9d0 con 0x7f42cc004d40 2024-09-10T11:38:38.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.768+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e40cfe20 con 0x7f42cc004d40 2024-09-10T11:38:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.769+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f42dc021070 con 0x7f42cc004d40 2024-09-10T11:38:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.769+0000 7f42e1ffb640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42d00750a0 0x7f42d0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.769+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42dc097590 con 0x7f42cc004d40 2024-09-10T11:38:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.769+0000 7f42e8b7d640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42d00750a0 0x7f42d0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:38.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.770+0000 7f42e8b7d640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42d00750a0 0x7f42d0077560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42d8001860 tx=0x7f42d8001020 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:38.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.772+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f42dc0044a0 con 0x7f42cc004d40 2024-09-10T11:38:38.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.958+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42e40cef10 con 0x7f42cc004d40 2024-09-10T11:38:38.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.959+0000 7f42e1ffb640 1 -- 172.21.15.57:0/956783831 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f42dc061380 con 0x7f42cc004d40 2024-09-10T11:38:38.960 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:38.960 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"btime":"2024-09-10T11:38:38:638948+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1421680054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1421680054},{"type":"v1","addr":"172.21.15.154:6836","nonce":1421680054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2099486363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2099486363},{"type":"v1","addr":"172.21.15.154:6837","nonce":2099486363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1163026307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1163026307},{"type":"v1","addr":"172.21.15.57:6834","nonce":1163026307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T11:38:35.954765+0000","modified":"2024-09-10T11:38:37.958197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4368},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4368":{"gid":4368,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/470389392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":470389392},{"type":"v1","addr":"172.21.15.57:6835","nonce":470389392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4368,"qdb_cluster":[4368]},"id":1}]} 2024-09-10T11:38:38.960 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 6 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42d00750a0 msgr2=0x7f42d0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42d00750a0 0x7f42d0077560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42d8001860 tx=0x7f42d8001020 comp rx=0 tx=0).stop 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 msgr2=0x7f42e4152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42e4152bb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42dc011b10 tx=0x7f42dc009eb0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 shutdown_connections 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42d00750a0 0x7f42d0077560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e41f6070 0x7f42e41f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e4156130 0x7f42e41f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 --2- 172.21.15.57:0/956783831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42cc004d40 0x7f42e4152bb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:38.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 >> 172.21.15.57:0/956783831 conn(0x7f42e406ccf0 msgr2=0x7f42e415f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:38.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 shutdown_connections 2024-09-10T11:38:38.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:38.961+0000 7f42eb5e2640 1 -- 172.21.15.57:0/956783831 wait complete. 2024-09-10T11:38:38.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:39.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 -- 172.21.15.57:0/386132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 msgr2=0x7fc3cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 --2- 172.21.15.57:0/386132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3cc003e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009b20 tx=0x7fc3cc005830 comp rx=0 tx=0).stop 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 -- 172.21.15.57:0/386132427 shutdown_connections 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 --2- 172.21.15.57:0/386132427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3cc003e70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 -- 172.21.15.57:0/386132427 >> 172.21.15.57:0/386132427 conn(0x7fc3e409aa20 msgr2=0x7fc3e409ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 -- 172.21.15.57:0/386132427 shutdown_connections 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.077+0000 7fc3ea431640 1 -- 172.21.15.57:0/386132427 wait complete. 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.079+0000 7fc3ea431640 1 Processor -- start 2024-09-10T11:38:39.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.079+0000 7fc3ea431640 1 -- start start 2024-09-10T11:38:39.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3e4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41f2440 0x7fc3e41f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40ca380 0x7fc3e415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e415cf20 con 0x7fc3cc003a50 2024-09-10T11:38:39.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e415cda0 con 0x7fc3e40ca380 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e40d1b10 con 0x7fc3e41f2440 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3e4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3e4158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57182/0 (socket says 172.21.15.57:57182) 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 -- 172.21.15.57:0/719000372 learned_addr learned my addr 172.21.15.57:0/719000372 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 -- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41f2440 msgr2=0x7fc3e41f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e89ce640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40ca380 0x7fc3e415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41f2440 0x7fc3e41f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 -- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40ca380 msgr2=0x7fc3e415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40ca380 0x7fc3e415b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 -- 172.21.15.57:0/719000372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e41f2930 con 0x7fc3cc003a50 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e3fff640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3e4158c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3d402b4a0 tx=0x7fc3d4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4038040 con 0x7fc3cc003a50 2024-09-10T11:38:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3d4004020 con 0x7fc3cc003a50 2024-09-10T11:38:39.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4004450 con 0x7fc3cc003a50 2024-09-10T11:38:39.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e41f2c10 con 0x7fc3cc003a50 2024-09-10T11:38:39.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.080+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e41f31d0 con 0x7fc3cc003a50 2024-09-10T11:38:39.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.081+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e40d1fe0 con 0x7fc3cc003a50 2024-09-10T11:38:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.082+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fc3d4045020 con 0x7fc3cc003a50 2024-09-10T11:38:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.083+0000 7fc3e0ff9640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc3d00750a0 0x7fc3d0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.083+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3d40b69b0 con 0x7fc3cc003a50 2024-09-10T11:38:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.083+0000 7fc3e37fe640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc3d00750a0 0x7fc3d0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.083+0000 7fc3e37fe640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc3d00750a0 0x7fc3d0077560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8000f60 tx=0x7fc3d8000ed0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:39.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.087+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fc3d4080d00 con 0x7fc3cc003a50 2024-09-10T11:38:39.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.253+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3e40c8cc0 con 0x7fc3cc003a50 2024-09-10T11:38:39.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.254+0000 7fc3e0ff9640 1 -- 172.21.15.57:0/719000372 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fc3d40891b0 con 0x7fc3cc003a50 2024-09-10T11:38:39.255 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:39.255 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:37.629806+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:38:33.708684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:38:34.920262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc3d00750a0 msgr2=0x7fc3d0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc3d00750a0 0x7fc3d0077560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8000f60 tx=0x7fc3d8000ed0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 msgr2=0x7fc3e4158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3e4158c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3d402b4a0 tx=0x7fc3d4033670 comp rx=0 tx=0).stop 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 shutdown_connections 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc3d00750a0 0x7fc3d0077560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40ca380 0x7fc3e415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41f2440 0x7fc3e41f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 --2- 172.21.15.57:0/719000372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3cc003a50 0x7fc3e4158c40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 >> 172.21.15.57:0/719000372 conn(0x7fc3e409aa20 msgr2=0x7fc3e40cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:39.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 shutdown_connections 2024-09-10T11:38:39.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.256+0000 7fc3ea431640 1 -- 172.21.15.57:0/719000372 wait complete. 2024-09-10T11:38:39.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T11:38:39.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:39.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 -- 172.21.15.57:0/3621938409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 msgr2=0x7fcb4c06fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/3621938409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c06fbb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0b5060 tx=0x7fcb3c02aac0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 -- 172.21.15.57:0/3621938409 shutdown_connections 2024-09-10T11:38:39.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/3621938409 >> v2:172.21.15.154:3300/0 conn(0x7fcb4c06f080 0x7fcb4c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/3621938409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c06fbb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 -- 172.21.15.57:0/3621938409 >> 172.21.15.57:0/3621938409 conn(0x7fcb4c06cab0 msgr2=0x7fcb4c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 -- 172.21.15.57:0/3621938409 shutdown_connections 2024-09-10T11:38:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.373+0000 7fcb53ec8640 1 -- 172.21.15.57:0/3621938409 wait complete. 2024-09-10T11:38:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.374+0000 7fcb53ec8640 1 Processor -- start 2024-09-10T11:38:39.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.374+0000 7fcb53ec8640 1 -- start start 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb53ec8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c06f080 0x7fcb4c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb53ec8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c0d0200 0x7fcb4c1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb53ec8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c1f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb53ec8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c070270 con 0x7fcb4c15bac0 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb53ec8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0700f0 con 0x7fcb4c06f080 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb53ec8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c15fd70 con 0x7fcb4c0d0200 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c1f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c1f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57208/0 (socket says 172.21.15.57:57208) 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 -- 172.21.15.57:0/410926357 learned_addr learned my addr 172.21.15.57:0/410926357 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb51463640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c0d0200 0x7fcb4c1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb51c64640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c06f080 0x7fcb4c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 -- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c0d0200 msgr2=0x7fcb4c1f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c0d0200 0x7fcb4c1f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 -- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c06f080 msgr2=0x7fcb4c14c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c06f080 0x7fcb4c14c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb52465640 1 -- 172.21.15.57:0/410926357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c14dd80 con 0x7fcb4c15bac0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.375+0000 7fcb51463640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c0d0200 0x7fcb4c1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.376+0000 7fcb52465640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c1f5ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c3d0 tx=0x7fcb4400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.376+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44017070 con 0x7fcb4c15bac0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.376+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb440035f0 con 0x7fcb4c15bac0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.376+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c14e000 con 0x7fcb4c15bac0 2024-09-10T11:38:39.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.376+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44003a40 con 0x7fcb4c15bac0 2024-09-10T11:38:39.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.376+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c14e5c0 con 0x7fcb4c15bac0 2024-09-10T11:38:39.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.377+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c160240 con 0x7fcb4c15bac0 2024-09-10T11:38:39.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.377+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fcb4401a070 con 0x7fcb4c15bac0 2024-09-10T11:38:39.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.378+0000 7fcb4a7fc640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb380750a0 0x7fcb38077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.378+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb44095610 con 0x7fcb4c15bac0 2024-09-10T11:38:39.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.378+0000 7fcb51c64640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb380750a0 0x7fcb38077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.379+0000 7fcb51c64640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb380750a0 0x7fcb38077560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c035000 tx=0x7fcb3c004ab0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:39.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.382+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fcb4c14dd80 con 0x7fcb4c15bac0 2024-09-10T11:38:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.538+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb4c15a3f0 con 0x7fcb380750a0 2024-09-10T11:38:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.543+0000 7fcb4a7fc640 1 -- 172.21.15.57:0/410926357 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237503 (secure 0 0 0) 0x7fcb3c07ffd0 con 0x7fcb380750a0 2024-09-10T11:38:39.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb380750a0 msgr2=0x7fcb38077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb380750a0 0x7fcb38077560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c035000 tx=0x7fcb3c004ab0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 msgr2=0x7fcb4c1f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c1f5ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c3d0 tx=0x7fcb4400c890 comp rx=0 tx=0).stop 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 shutdown_connections 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb380750a0 0x7fcb38077560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c15bac0 0x7fcb4c1f5ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c0d0200 0x7fcb4c1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 --2- 172.21.15.57:0/410926357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c06f080 0x7fcb4c14c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 >> 172.21.15.57:0/410926357 conn(0x7fcb4c06cab0 msgr2=0x7fcb4c158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 shutdown_connections 2024-09-10T11:38:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.546+0000 7fcb53ec8640 1 -- 172.21.15.57:0/410926357 wait complete. 2024-09-10T11:38:39.557 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T11:38:38.190013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":235844,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738876,"statfs":{"total":773094113280,"available":772852609024,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000829"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615527+0000","last_change":"2024-09-10T11:38:34.615527+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615527+0000","last_undegraded":"2024-09-10T11:38:34.615527+0000","last_fullsized":"2024-09-10T11:38:34.615527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.616326+0000","last_change":"2024-09-10T11:38:34.616326+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.616326+0000","last_undegraded":"2024-09-10T11:38:34.616326+0000","last_fullsized":"2024-09-10T11:38:34.616326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615478+0000","last_change":"2024-09-10T11:38:34.615478+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615478+0000","last_undegraded":"2024-09-10T11:38:34.615478+0000","last_fullsized":"2024-09-10T11:38:34.615478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615422+0000","last_change":"2024-09-10T11:38:34.615422+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615422+0000","last_undegraded":"2024-09-10T11:38:34.615422+0000","last_fullsized":"2024-09-10T11:38:34.615422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T11:38:28.685658+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:28.685658+0000","last_peered":"2024-09-10T11:38:28.685658+0000","last_clean":"2024-09-10T11:38:28.685658+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:28.685658+0000","last_undegraded":"2024-09-10T11:38:28.685658+0000","last_fullsized":"2024-09-10T11:38:28.685658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615801+0000","last_change":"2024-09-10T11:38:34.615801+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615801+0000","last_undegraded":"2024-09-10T11:38:34.615801+0000","last_fullsized":"2024-09-10T11:38:34.615801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:39.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/4005971546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d04b0 msgr2=0x7ff9f40d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/4005971546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d04b0 0x7ff9f40d1b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005fd0 tx=0x7ff9e802a540 comp rx=0 tx=0).stop 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/4005971546 shutdown_connections 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/4005971546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d04b0 0x7ff9f40d1b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/4005971546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9f40d00d0 0x7ff9f415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/4005971546 >> 172.21.15.57:0/4005971546 conn(0x7ff9f409aa20 msgr2=0x7ff9f409ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/4005971546 shutdown_connections 2024-09-10T11:38:39.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.703+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/4005971546 wait complete. 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.705+0000 7ff9f9dbb640 1 Processor -- start 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.705+0000 7ff9f9dbb640 1 -- start start 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 0x7ff9f40b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9f40d04b0 0x7ff9f415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40d2050 0x7ff9f4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f415fea0 con 0x7ff9f40d00d0 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40cd9a0 con 0x7ff9f40d2050 2024-09-10T11:38:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f4160020 con 0x7ff9f40d04b0 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 0x7ff9f40b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 0x7ff9f40b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46450/0 (socket says 172.21.15.57:46450) 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 -- 172.21.15.57:0/827609150 learned_addr learned my addr 172.21.15.57:0/827609150 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f2ffd640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9f40d04b0 0x7ff9f415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f3fff640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40d2050 0x7ff9f4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 -- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9f40d04b0 msgr2=0x7ff9f415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9f40d04b0 0x7ff9f415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 -- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40d2050 msgr2=0x7ff9f4154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40d2050 0x7ff9f4154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 -- 172.21.15.57:0/827609150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f4159fa0 con 0x7ff9f40d00d0 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f37fe640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 0x7ff9f40b75b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400d770 tx=0x7ff9e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:39.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4017070 con 0x7ff9f40d00d0 2024-09-10T11:38:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9e4009d20 con 0x7ff9f40d00d0 2024-09-10T11:38:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f415a280 con 0x7ff9f40d00d0 2024-09-10T11:38:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40106c0 con 0x7ff9f40d00d0 2024-09-10T11:38:39.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.706+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f415a840 con 0x7ff9f40d00d0 2024-09-10T11:38:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.707+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f4160540 con 0x7ff9f40d00d0 2024-09-10T11:38:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.708+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7ff9e401a070 con 0x7ff9f40d00d0 2024-09-10T11:38:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.709+0000 7ff9dbfff640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff9e00750a0 0x7ff9e0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.709+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff9e40963f0 con 0x7ff9f40d00d0 2024-09-10T11:38:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.709+0000 7ff9f2ffd640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff9e00750a0 0x7ff9e0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.709+0000 7ff9f2ffd640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff9e00750a0 0x7ff9e0077560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8033000 tx=0x7ff9e8004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:39.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.713+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7ff9e4060100 con 0x7ff9f40d00d0 2024-09-10T11:38:39.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.870+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9f4159d50 con 0x7ff9e00750a0 2024-09-10T11:38:39.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.874+0000 7ff9dbfff640 1 -- 172.21.15.57:0/827609150 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237503 (secure 0 0 0) 0x7ff9f4159d50 con 0x7ff9e00750a0 2024-09-10T11:38:39.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:39.878 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff9e00750a0 msgr2=0x7ff9e0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff9e00750a0 0x7ff9e0077560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8033000 tx=0x7ff9e8004730 comp rx=0 tx=0).stop 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 msgr2=0x7ff9f40b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 0x7ff9f40b75b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400d770 tx=0x7ff9e400dc30 comp rx=0 tx=0).stop 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 shutdown_connections 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff9e00750a0 0x7ff9e0077560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f40d2050 0x7ff9f4154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9f40d04b0 0x7ff9f415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 --2- 172.21.15.57:0/827609150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9f40d00d0 0x7ff9f40b75b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:39.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 >> 172.21.15.57:0/827609150 conn(0x7ff9f409aa20 msgr2=0x7ff9f40755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:39.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 shutdown_connections 2024-09-10T11:38:39.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:39.877+0000 7ff9f9dbb640 1 -- 172.21.15.57:0/827609150 wait complete. 2024-09-10T11:38:39.889 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T11:38:38.190013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":235844,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738876,"statfs":{"total":773094113280,"available":772852609024,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000829"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615527+0000","last_change":"2024-09-10T11:38:34.615527+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615527+0000","last_undegraded":"2024-09-10T11:38:34.615527+0000","last_fullsized":"2024-09-10T11:38:34.615527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.616326+0000","last_change":"2024-09-10T11:38:34.616326+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.616326+0000","last_undegraded":"2024-09-10T11:38:34.616326+0000","last_fullsized":"2024-09-10T11:38:34.616326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615478+0000","last_change":"2024-09-10T11:38:34.615478+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615478+0000","last_undegraded":"2024-09-10T11:38:34.615478+0000","last_fullsized":"2024-09-10T11:38:34.615478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615422+0000","last_change":"2024-09-10T11:38:34.615422+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615422+0000","last_undegraded":"2024-09-10T11:38:34.615422+0000","last_fullsized":"2024-09-10T11:38:34.615422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":103,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T11:38:28.685658+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:28.685658+0000","last_peered":"2024-09-10T11:38:28.685658+0000","last_clean":"2024-09-10T11:38:28.685658+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:28.685658+0000","last_undegraded":"2024-09-10T11:38:28.685658+0000","last_fullsized":"2024-09-10T11:38:28.685658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T11:38:34.615801+0000","last_change":"2024-09-10T11:38:34.615801+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.615801+0000","last_undegraded":"2024-09-10T11:38:34.615801+0000","last_fullsized":"2024-09-10T11:38:34.615801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:35.610253+0000","last_change":"2024-09-10T11:38:35.610253+0000","last_active":"2024-09-10T11:38:35.610253+0000","last_peered":"2024-09-10T11:38:35.610253+0000","last_clean":"2024-09-10T11:38:35.610253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:35.610253+0000","last_undegraded":"2024-09-10T11:38:35.610253+0000","last_fullsized":"2024-09-10T11:38:35.610253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T11:38:34.596301+0000","last_change":"2024-09-10T11:38:34.596301+0000","last_active":"2024-09-10T11:38:34.596301+0000","last_peered":"2024-09-10T11:38:34.596301+0000","last_clean":"2024-09-10T11:38:34.596301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T11:38:34.596301+0000","last_undegraded":"2024-09-10T11:38:34.596301+0000","last_fullsized":"2024-09-10T11:38:34.596301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:39.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 -- 172.21.15.57:0/47931444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f103815bd50 msgr2=0x7f10380d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 --2- 172.21.15.57:0/47931444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f103815bd50 0x7f10380d1a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1028009830 tx=0x7f102802a510 comp rx=0 tx=0).stop 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 -- 172.21.15.57:0/47931444 shutdown_connections 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 --2- 172.21.15.57:0/47931444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f103815bd50 0x7f10380d1a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 --2- 172.21.15.57:0/47931444 >> v2:172.21.15.154:3300/0 conn(0x7f103815b970 0x7f10380d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 -- 172.21.15.57:0/47931444 >> 172.21.15.57:0/47931444 conn(0x7f1038074840 msgr2=0x7f103809aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 -- 172.21.15.57:0/47931444 shutdown_connections 2024-09-10T11:38:40.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.034+0000 7f10403a4640 1 -- 172.21.15.57:0/47931444 wait complete. 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.035+0000 7f10403a4640 1 Processor -- start 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 -- start start 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10380b0c30 0x7f103815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 0x7f10380cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103815bd50 0x7f103815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f10380d2330 con 0x7f103815b970 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f10380d21b0 con 0x7f103815bd50 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f10403a4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f103815fdf0 con 0x7f10380b0c30 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f103d93f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 0x7f10380cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f103d93f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 0x7f10380cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46458/0 (socket says 172.21.15.57:46458) 2024-09-10T11:38:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.036+0000 7f103d93f640 1 -- 172.21.15.57:0/1306569184 learned_addr learned my addr 172.21.15.57:0/1306569184 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103e941640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103815bd50 0x7f103815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103e140640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10380b0c30 0x7f103815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103d93f640 1 -- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10380b0c30 msgr2=0x7f103815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103d93f640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10380b0c30 0x7f103815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103d93f640 1 -- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103815bd50 msgr2=0x7f103815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103d93f640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103815bd50 0x7f103815e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103d93f640 1 -- 172.21.15.57:0/1306569184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103815e040 con 0x7f103815b970 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f103d93f640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 0x7f10380cb910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1028009950 tx=0x7f1028032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028040070 con 0x7f103815b970 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1028005310 con 0x7f103815b970 2024-09-10T11:38:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10280047a0 con 0x7f103815b970 2024-09-10T11:38:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10381f2f30 con 0x7f103815b970 2024-09-10T11:38:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.037+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103815c500 con 0x7f103815b970 2024-09-10T11:38:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.038+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1038160310 con 0x7f103815b970 2024-09-10T11:38:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.039+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f1028039040 con 0x7f103815b970 2024-09-10T11:38:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.039+0000 7f102effd640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f101c0750a0 0x7f101c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.039+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f10280b73c0 con 0x7f103815b970 2024-09-10T11:38:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.040+0000 7f103e140640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f101c0750a0 0x7f101c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.040+0000 7f103e140640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f101c0750a0 0x7f101c077560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10380c8ad0 tx=0x7f1034005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:40.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.043+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f1028080fb0 con 0x7f103815b970 2024-09-10T11:38:40.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.201+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f103815cc10 con 0x7f101c0750a0 2024-09-10T11:38:40.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.206+0000 7f102effd640 1 -- 172.21.15.57:0/1306569184 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f103815cc10 con 0x7f101c0750a0 2024-09-10T11:38:40.209 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:40.210 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f101c0750a0 msgr2=0x7f101c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f101c0750a0 0x7f101c077560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10380c8ad0 tx=0x7f1034005f90 comp rx=0 tx=0).stop 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 msgr2=0x7f10380cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 0x7f10380cb910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1028009950 tx=0x7f1028032c10 comp rx=0 tx=0).stop 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 shutdown_connections 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f101c0750a0 0x7f101c077560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103815bd50 0x7f103815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f103815b970 0x7f10380cb910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 --2- 172.21.15.57:0/1306569184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10380b0c30 0x7f103815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 >> 172.21.15.57:0/1306569184 conn(0x7f1038074840 msgr2=0x7f103815ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 shutdown_connections 2024-09-10T11:38:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.209+0000 7f10403a4640 1 -- 172.21.15.57:0/1306569184 wait complete. 2024-09-10T11:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T11:38:40.190591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":2940928,"data_stored":1765196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.579926"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166415+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:38:39.166415+0000","last_peered":"2024-09-10T11:38:39.166415+0000","last_clean":"2024-09-10T11:38:39.166415+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:38:39.166415+0000","last_undegraded":"2024-09-10T11:38:39.166415+0000","last_fullsized":"2024-09-10T11:38:39.166415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634990+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:38:37.634990+0000","last_peered":"2024-09-10T11:38:37.634990+0000","last_clean":"2024-09-10T11:38:37.634990+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:38:37.634990+0000","last_undegraded":"2024-09-10T11:38:37.634990+0000","last_fullsized":"2024-09-10T11:38:37.634990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166638+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:38:39.166638+0000","last_peered":"2024-09-10T11:38:39.166638+0000","last_clean":"2024-09-10T11:38:39.166638+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:38:39.166638+0000","last_undegraded":"2024-09-10T11:38:39.166638+0000","last_fullsized":"2024-09-10T11:38:39.166638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636583+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:38:37.636583+0000","last_peered":"2024-09-10T11:38:37.636583+0000","last_clean":"2024-09-10T11:38:37.636583+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:38:37.636583+0000","last_undegraded":"2024-09-10T11:38:37.636583+0000","last_fullsized":"2024-09-10T11:38:37.636583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166387+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:38:39.166387+0000","last_peered":"2024-09-10T11:38:39.166387+0000","last_clean":"2024-09-10T11:38:39.166387+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:38:39.166387+0000","last_undegraded":"2024-09-10T11:38:39.166387+0000","last_fullsized":"2024-09-10T11:38:39.166387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637139+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:38:37.637139+0000","last_peered":"2024-09-10T11:38:37.637139+0000","last_clean":"2024-09-10T11:38:37.637139+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:38:37.637139+0000","last_undegraded":"2024-09-10T11:38:37.637139+0000","last_fullsized":"2024-09-10T11:38:37.637139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165949+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:38:39.165949+0000","last_peered":"2024-09-10T11:38:39.165949+0000","last_clean":"2024-09-10T11:38:39.165949+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:38:39.165949+0000","last_undegraded":"2024-09-10T11:38:39.165949+0000","last_fullsized":"2024-09-10T11:38:39.165949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137244+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:38:39.137244+0000","last_peered":"2024-09-10T11:38:39.137244+0000","last_clean":"2024-09-10T11:38:39.137244+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:38:39.137244+0000","last_undegraded":"2024-09-10T11:38:39.137244+0000","last_fullsized":"2024-09-10T11:38:39.137244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166432+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:38:39.166432+0000","last_peered":"2024-09-10T11:38:39.166432+0000","last_clean":"2024-09-10T11:38:39.166432+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:38:39.166432+0000","last_undegraded":"2024-09-10T11:38:39.166432+0000","last_fullsized":"2024-09-10T11:38:39.166432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638355+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:38:38.638355+0000","last_peered":"2024-09-10T11:38:38.638355+0000","last_clean":"2024-09-10T11:38:38.638355+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:38:38.638355+0000","last_undegraded":"2024-09-10T11:38:38.638355+0000","last_fullsized":"2024-09-10T11:38:38.638355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638239+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:38:38.638239+0000","last_peered":"2024-09-10T11:38:38.638239+0000","last_clean":"2024-09-10T11:38:38.638239+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:38:38.638239+0000","last_undegraded":"2024-09-10T11:38:38.638239+0000","last_fullsized":"2024-09-10T11:38:38.638239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637846+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:38:37.637846+0000","last_peered":"2024-09-10T11:38:37.637846+0000","last_clean":"2024-09-10T11:38:37.637846+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:38:37.637846+0000","last_undegraded":"2024-09-10T11:38:37.637846+0000","last_fullsized":"2024-09-10T11:38:37.637846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137648+0000","last_change":"2024-09-10T11:38:36.649867+0000","last_active":"2024-09-10T11:38:39.137648+0000","last_peered":"2024-09-10T11:38:39.137648+0000","last_clean":"2024-09-10T11:38:39.137648+0000","last_became_active":"2024-09-10T11:38:36.648237+0000","last_became_peered":"2024-09-10T11:38:36.648237+0000","last_unstale":"2024-09-10T11:38:39.137648+0000","last_undegraded":"2024-09-10T11:38:39.137648+0000","last_fullsized":"2024-09-10T11:38:39.137648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166145+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:38:39.166145+0000","last_peered":"2024-09-10T11:38:39.166145+0000","last_clean":"2024-09-10T11:38:39.166145+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:38:39.166145+0000","last_undegraded":"2024-09-10T11:38:39.166145+0000","last_fullsized":"2024-09-10T11:38:39.166145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634591+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:38:37.634591+0000","last_peered":"2024-09-10T11:38:37.634591+0000","last_clean":"2024-09-10T11:38:37.634591+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:38:37.634591+0000","last_undegraded":"2024-09-10T11:38:37.634591+0000","last_fullsized":"2024-09-10T11:38:37.634591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636309+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:38:37.636309+0000","last_peered":"2024-09-10T11:38:37.636309+0000","last_clean":"2024-09-10T11:38:37.636309+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:38:37.636309+0000","last_undegraded":"2024-09-10T11:38:37.636309+0000","last_fullsized":"2024-09-10T11:38:37.636309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637255+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:38:37.637255+0000","last_peered":"2024-09-10T11:38:37.637255+0000","last_clean":"2024-09-10T11:38:37.637255+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:38:37.637255+0000","last_undegraded":"2024-09-10T11:38:37.637255+0000","last_fullsized":"2024-09-10T11:38:37.637255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165966+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:38:39.165966+0000","last_peered":"2024-09-10T11:38:39.165966+0000","last_clean":"2024-09-10T11:38:39.165966+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:38:39.165966+0000","last_undegraded":"2024-09-10T11:38:39.165966+0000","last_fullsized":"2024-09-10T11:38:39.165966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166663+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:38:39.166663+0000","last_peered":"2024-09-10T11:38:39.166663+0000","last_clean":"2024-09-10T11:38:39.166663+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:38:39.166663+0000","last_undegraded":"2024-09-10T11:38:39.166663+0000","last_fullsized":"2024-09-10T11:38:39.166663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638287+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:38:38.638287+0000","last_peered":"2024-09-10T11:38:38.638287+0000","last_clean":"2024-09-10T11:38:38.638287+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:38:38.638287+0000","last_undegraded":"2024-09-10T11:38:38.638287+0000","last_fullsized":"2024-09-10T11:38:38.638287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166357+0000","last_change":"2024-09-10T11:38:36.643946+0000","last_active":"2024-09-10T11:38:39.166357+0000","last_peered":"2024-09-10T11:38:39.166357+0000","last_clean":"2024-09-10T11:38:39.166357+0000","last_became_active":"2024-09-10T11:38:36.643648+0000","last_became_peered":"2024-09-10T11:38:36.643648+0000","last_unstale":"2024-09-10T11:38:39.166357+0000","last_undegraded":"2024-09-10T11:38:39.166357+0000","last_fullsized":"2024-09-10T11:38:39.166357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637479+0000","last_change":"2024-09-10T11:38:36.643116+0000","last_active":"2024-09-10T11:38:37.637479+0000","last_peered":"2024-09-10T11:38:37.637479+0000","last_clean":"2024-09-10T11:38:37.637479+0000","last_became_active":"2024-09-10T11:38:36.642805+0000","last_became_peered":"2024-09-10T11:38:36.642805+0000","last_unstale":"2024-09-10T11:38:37.637479+0000","last_undegraded":"2024-09-10T11:38:37.637479+0000","last_fullsized":"2024-09-10T11:38:37.637479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:53.917503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137290+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:38:39.137290+0000","last_peered":"2024-09-10T11:38:39.137290+0000","last_clean":"2024-09-10T11:38:39.137290+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:38:39.137290+0000","last_undegraded":"2024-09-10T11:38:39.137290+0000","last_fullsized":"2024-09-10T11:38:39.137290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636477+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:38:37.636477+0000","last_peered":"2024-09-10T11:38:37.636477+0000","last_clean":"2024-09-10T11:38:37.636477+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:38:37.636477+0000","last_undegraded":"2024-09-10T11:38:37.636477+0000","last_fullsized":"2024-09-10T11:38:37.636477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137797+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:38:39.137797+0000","last_peered":"2024-09-10T11:38:39.137797+0000","last_clean":"2024-09-10T11:38:39.137797+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:38:39.137797+0000","last_undegraded":"2024-09-10T11:38:39.137797+0000","last_fullsized":"2024-09-10T11:38:39.137797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638350+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:38:38.638350+0000","last_peered":"2024-09-10T11:38:38.638350+0000","last_clean":"2024-09-10T11:38:38.638350+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:38:38.638350+0000","last_undegraded":"2024-09-10T11:38:38.638350+0000","last_fullsized":"2024-09-10T11:38:38.638350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634892+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:38:37.634892+0000","last_peered":"2024-09-10T11:38:37.634892+0000","last_clean":"2024-09-10T11:38:37.634892+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:38:37.634892+0000","last_undegraded":"2024-09-10T11:38:37.634892+0000","last_fullsized":"2024-09-10T11:38:37.634892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137925+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:38:39.137925+0000","last_peered":"2024-09-10T11:38:39.137925+0000","last_clean":"2024-09-10T11:38:39.137925+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:38:39.137925+0000","last_undegraded":"2024-09-10T11:38:39.137925+0000","last_fullsized":"2024-09-10T11:38:39.137925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166405+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:38:39.166405+0000","last_peered":"2024-09-10T11:38:39.166405+0000","last_clean":"2024-09-10T11:38:39.166405+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:38:39.166405+0000","last_undegraded":"2024-09-10T11:38:39.166405+0000","last_fullsized":"2024-09-10T11:38:39.166405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637858+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:38:37.637858+0000","last_peered":"2024-09-10T11:38:37.637858+0000","last_clean":"2024-09-10T11:38:37.637858+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:38:37.637858+0000","last_undegraded":"2024-09-10T11:38:37.637858+0000","last_fullsized":"2024-09-10T11:38:37.637858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165985+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:38:39.165985+0000","last_peered":"2024-09-10T11:38:39.165985+0000","last_clean":"2024-09-10T11:38:39.165985+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:38:39.165985+0000","last_undegraded":"2024-09-10T11:38:39.165985+0000","last_fullsized":"2024-09-10T11:38:39.165985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638232+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:38:38.638232+0000","last_peered":"2024-09-10T11:38:38.638232+0000","last_clean":"2024-09-10T11:38:38.638232+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:38:38.638232+0000","last_undegraded":"2024-09-10T11:38:38.638232+0000","last_fullsized":"2024-09-10T11:38:38.638232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636281+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:38:37.636281+0000","last_peered":"2024-09-10T11:38:37.636281+0000","last_clean":"2024-09-10T11:38:37.636281+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:38:37.636281+0000","last_undegraded":"2024-09-10T11:38:37.636281+0000","last_fullsized":"2024-09-10T11:38:37.636281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137814+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:38:39.137814+0000","last_peered":"2024-09-10T11:38:39.137814+0000","last_clean":"2024-09-10T11:38:39.137814+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:38:39.137814+0000","last_undegraded":"2024-09-10T11:38:39.137814+0000","last_fullsized":"2024-09-10T11:38:39.137814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166662+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:38:39.166662+0000","last_peered":"2024-09-10T11:38:39.166662+0000","last_clean":"2024-09-10T11:38:39.166662+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:38:39.166662+0000","last_undegraded":"2024-09-10T11:38:39.166662+0000","last_fullsized":"2024-09-10T11:38:39.166662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637823+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:38:38.637823+0000","last_peered":"2024-09-10T11:38:38.637823+0000","last_clean":"2024-09-10T11:38:38.637823+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:38:38.637823+0000","last_undegraded":"2024-09-10T11:38:38.637823+0000","last_fullsized":"2024-09-10T11:38:38.637823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137316+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:38:39.137316+0000","last_peered":"2024-09-10T11:38:39.137316+0000","last_clean":"2024-09-10T11:38:39.137316+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:38:39.137316+0000","last_undegraded":"2024-09-10T11:38:39.137316+0000","last_fullsized":"2024-09-10T11:38:39.137316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137319+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:38:39.137319+0000","last_peered":"2024-09-10T11:38:39.137319+0000","last_clean":"2024-09-10T11:38:39.137319+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:38:39.137319+0000","last_undegraded":"2024-09-10T11:38:39.137319+0000","last_fullsized":"2024-09-10T11:38:39.137319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636420+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:38:37.636420+0000","last_peered":"2024-09-10T11:38:37.636420+0000","last_clean":"2024-09-10T11:38:37.636420+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:38:37.636420+0000","last_undegraded":"2024-09-10T11:38:37.636420+0000","last_fullsized":"2024-09-10T11:38:37.636420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634585+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:38:37.634585+0000","last_peered":"2024-09-10T11:38:37.634585+0000","last_clean":"2024-09-10T11:38:37.634585+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:38:37.634585+0000","last_undegraded":"2024-09-10T11:38:37.634585+0000","last_fullsized":"2024-09-10T11:38:37.634585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638124+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:38:38.638124+0000","last_peered":"2024-09-10T11:38:38.638124+0000","last_clean":"2024-09-10T11:38:38.638124+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:38:38.638124+0000","last_undegraded":"2024-09-10T11:38:38.638124+0000","last_fullsized":"2024-09-10T11:38:38.638124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636901+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:38:37.636901+0000","last_peered":"2024-09-10T11:38:37.636901+0000","last_clean":"2024-09-10T11:38:37.636901+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:38:37.636901+0000","last_undegraded":"2024-09-10T11:38:37.636901+0000","last_fullsized":"2024-09-10T11:38:37.636901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636860+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:38:37.636860+0000","last_peered":"2024-09-10T11:38:37.636860+0000","last_clean":"2024-09-10T11:38:37.636860+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:38:37.636860+0000","last_undegraded":"2024-09-10T11:38:37.636860+0000","last_fullsized":"2024-09-10T11:38:37.636860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166003+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:38:39.166003+0000","last_peered":"2024-09-10T11:38:39.166003+0000","last_clean":"2024-09-10T11:38:39.166003+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:38:39.166003+0000","last_undegraded":"2024-09-10T11:38:39.166003+0000","last_fullsized":"2024-09-10T11:38:39.166003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634824+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:38:37.634824+0000","last_peered":"2024-09-10T11:38:37.634824+0000","last_clean":"2024-09-10T11:38:37.634824+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:38:37.634824+0000","last_undegraded":"2024-09-10T11:38:37.634824+0000","last_fullsized":"2024-09-10T11:38:37.634824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637941+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:38:37.637941+0000","last_peered":"2024-09-10T11:38:37.637941+0000","last_clean":"2024-09-10T11:38:37.637941+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:38:37.637941+0000","last_undegraded":"2024-09-10T11:38:37.637941+0000","last_fullsized":"2024-09-10T11:38:37.637941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637984+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:38:38.637984+0000","last_peered":"2024-09-10T11:38:38.637984+0000","last_clean":"2024-09-10T11:38:38.637984+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:38:38.637984+0000","last_undegraded":"2024-09-10T11:38:38.637984+0000","last_fullsized":"2024-09-10T11:38:38.637984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166328+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:38:39.166328+0000","last_peered":"2024-09-10T11:38:39.166328+0000","last_clean":"2024-09-10T11:38:39.166328+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:38:39.166328+0000","last_undegraded":"2024-09-10T11:38:39.166328+0000","last_fullsized":"2024-09-10T11:38:39.166328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166556+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:38:39.166556+0000","last_peered":"2024-09-10T11:38:39.166556+0000","last_clean":"2024-09-10T11:38:39.166556+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:38:39.166556+0000","last_undegraded":"2024-09-10T11:38:39.166556+0000","last_fullsized":"2024-09-10T11:38:39.166556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166356+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:38:39.166356+0000","last_peered":"2024-09-10T11:38:39.166356+0000","last_clean":"2024-09-10T11:38:39.166356+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:38:39.166356+0000","last_undegraded":"2024-09-10T11:38:39.166356+0000","last_fullsized":"2024-09-10T11:38:39.166356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637603+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:38:37.637603+0000","last_peered":"2024-09-10T11:38:37.637603+0000","last_clean":"2024-09-10T11:38:37.637603+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:38:37.637603+0000","last_undegraded":"2024-09-10T11:38:37.637603+0000","last_fullsized":"2024-09-10T11:38:37.637603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166332+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:38:39.166332+0000","last_peered":"2024-09-10T11:38:39.166332+0000","last_clean":"2024-09-10T11:38:39.166332+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:38:39.166332+0000","last_undegraded":"2024-09-10T11:38:39.166332+0000","last_fullsized":"2024-09-10T11:38:39.166332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637806+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:38:38.637806+0000","last_peered":"2024-09-10T11:38:38.637806+0000","last_clean":"2024-09-10T11:38:38.637806+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:38:38.637806+0000","last_undegraded":"2024-09-10T11:38:38.637806+0000","last_fullsized":"2024-09-10T11:38:38.637806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638020+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:38:38.638020+0000","last_peered":"2024-09-10T11:38:38.638020+0000","last_clean":"2024-09-10T11:38:38.638020+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:38:38.638020+0000","last_undegraded":"2024-09-10T11:38:38.638020+0000","last_fullsized":"2024-09-10T11:38:38.638020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165609+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:38:39.165609+0000","last_peered":"2024-09-10T11:38:39.165609+0000","last_clean":"2024-09-10T11:38:39.165609+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:38:39.165609+0000","last_undegraded":"2024-09-10T11:38:39.165609+0000","last_fullsized":"2024-09-10T11:38:39.165609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166134+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:38:39.166134+0000","last_peered":"2024-09-10T11:38:39.166134+0000","last_clean":"2024-09-10T11:38:39.166134+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:38:39.166134+0000","last_undegraded":"2024-09-10T11:38:39.166134+0000","last_fullsized":"2024-09-10T11:38:39.166134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637534+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:38:37.637534+0000","last_peered":"2024-09-10T11:38:37.637534+0000","last_clean":"2024-09-10T11:38:37.637534+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:38:37.637534+0000","last_undegraded":"2024-09-10T11:38:37.637534+0000","last_fullsized":"2024-09-10T11:38:37.637534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166467+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:38:39.166467+0000","last_peered":"2024-09-10T11:38:39.166467+0000","last_clean":"2024-09-10T11:38:39.166467+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:38:39.166467+0000","last_undegraded":"2024-09-10T11:38:39.166467+0000","last_fullsized":"2024-09-10T11:38:39.166467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166064+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:38:39.166064+0000","last_peered":"2024-09-10T11:38:39.166064+0000","last_clean":"2024-09-10T11:38:39.166064+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:38:39.166064+0000","last_undegraded":"2024-09-10T11:38:39.166064+0000","last_fullsized":"2024-09-10T11:38:39.166064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166661+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:38:39.166661+0000","last_peered":"2024-09-10T11:38:39.166661+0000","last_clean":"2024-09-10T11:38:39.166661+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:38:39.166661+0000","last_undegraded":"2024-09-10T11:38:39.166661+0000","last_fullsized":"2024-09-10T11:38:39.166661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634985+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:38:37.634985+0000","last_peered":"2024-09-10T11:38:37.634985+0000","last_clean":"2024-09-10T11:38:37.634985+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:38:37.634985+0000","last_undegraded":"2024-09-10T11:38:37.634985+0000","last_fullsized":"2024-09-10T11:38:37.634985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636810+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:38:37.636810+0000","last_peered":"2024-09-10T11:38:37.636810+0000","last_clean":"2024-09-10T11:38:37.636810+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:38:37.636810+0000","last_undegraded":"2024-09-10T11:38:37.636810+0000","last_fullsized":"2024-09-10T11:38:37.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165675+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:38:39.165675+0000","last_peered":"2024-09-10T11:38:39.165675+0000","last_clean":"2024-09-10T11:38:39.165675+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:38:39.165675+0000","last_undegraded":"2024-09-10T11:38:39.165675+0000","last_fullsized":"2024-09-10T11:38:39.165675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166382+0000","last_change":"2024-09-10T11:38:36.653163+0000","last_active":"2024-09-10T11:38:39.166382+0000","last_peered":"2024-09-10T11:38:39.166382+0000","last_clean":"2024-09-10T11:38:39.166382+0000","last_became_active":"2024-09-10T11:38:36.652861+0000","last_became_peered":"2024-09-10T11:38:36.652861+0000","last_unstale":"2024-09-10T11:38:39.166382+0000","last_undegraded":"2024-09-10T11:38:39.166382+0000","last_fullsized":"2024-09-10T11:38:39.166382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165892+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:39.165892+0000","last_peered":"2024-09-10T11:38:39.165892+0000","last_clean":"2024-09-10T11:38:39.165892+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:39.165892+0000","last_undegraded":"2024-09-10T11:38:39.165892+0000","last_fullsized":"2024-09-10T11:38:39.165892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636247+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:38:37.636247+0000","last_peered":"2024-09-10T11:38:37.636247+0000","last_clean":"2024-09-10T11:38:37.636247+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:38:37.636247+0000","last_undegraded":"2024-09-10T11:38:37.636247+0000","last_fullsized":"2024-09-10T11:38:37.636247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137684+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:38:39.137684+0000","last_peered":"2024-09-10T11:38:39.137684+0000","last_clean":"2024-09-10T11:38:39.137684+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:38:39.137684+0000","last_undegraded":"2024-09-10T11:38:39.137684+0000","last_fullsized":"2024-09-10T11:38:39.137684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166230+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:38:39.166230+0000","last_peered":"2024-09-10T11:38:39.166230+0000","last_clean":"2024-09-10T11:38:39.166230+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:38:39.166230+0000","last_undegraded":"2024-09-10T11:38:39.166230+0000","last_fullsized":"2024-09-10T11:38:39.166230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165865+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:38:39.165865+0000","last_peered":"2024-09-10T11:38:39.165865+0000","last_clean":"2024-09-10T11:38:39.165865+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:38:39.165865+0000","last_undegraded":"2024-09-10T11:38:39.165865+0000","last_fullsized":"2024-09-10T11:38:39.165865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166086+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:38:39.166086+0000","last_peered":"2024-09-10T11:38:39.166086+0000","last_clean":"2024-09-10T11:38:39.166086+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:38:39.166086+0000","last_undegraded":"2024-09-10T11:38:39.166086+0000","last_fullsized":"2024-09-10T11:38:39.166086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634619+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:38:37.634619+0000","last_peered":"2024-09-10T11:38:37.634619+0000","last_clean":"2024-09-10T11:38:37.634619+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:38:37.634619+0000","last_undegraded":"2024-09-10T11:38:37.634619+0000","last_fullsized":"2024-09-10T11:38:37.634619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637700+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:38:37.637700+0000","last_peered":"2024-09-10T11:38:37.637700+0000","last_clean":"2024-09-10T11:38:37.637700+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:38:37.637700+0000","last_undegraded":"2024-09-10T11:38:37.637700+0000","last_fullsized":"2024-09-10T11:38:37.637700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637363+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:38:37.637363+0000","last_peered":"2024-09-10T11:38:37.637363+0000","last_clean":"2024-09-10T11:38:37.637363+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:38:37.637363+0000","last_undegraded":"2024-09-10T11:38:37.637363+0000","last_fullsized":"2024-09-10T11:38:37.637363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634761+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:38:37.634761+0000","last_peered":"2024-09-10T11:38:37.634761+0000","last_clean":"2024-09-10T11:38:37.634761+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:38:37.634761+0000","last_undegraded":"2024-09-10T11:38:37.634761+0000","last_fullsized":"2024-09-10T11:38:37.634761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636997+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:38:37.636997+0000","last_peered":"2024-09-10T11:38:37.636997+0000","last_clean":"2024-09-10T11:38:37.636997+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:38:37.636997+0000","last_undegraded":"2024-09-10T11:38:37.636997+0000","last_fullsized":"2024-09-10T11:38:37.636997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166586+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:38:39.166586+0000","last_peered":"2024-09-10T11:38:39.166586+0000","last_clean":"2024-09-10T11:38:39.166586+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:38:39.166586+0000","last_undegraded":"2024-09-10T11:38:39.166586+0000","last_fullsized":"2024-09-10T11:38:39.166586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634718+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:38:37.634718+0000","last_peered":"2024-09-10T11:38:37.634718+0000","last_clean":"2024-09-10T11:38:37.634718+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:38:37.634718+0000","last_undegraded":"2024-09-10T11:38:37.634718+0000","last_fullsized":"2024-09-10T11:38:37.634718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637077+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:38:38.637077+0000","last_peered":"2024-09-10T11:38:38.637077+0000","last_clean":"2024-09-10T11:38:38.637077+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:38:38.637077+0000","last_undegraded":"2024-09-10T11:38:38.637077+0000","last_fullsized":"2024-09-10T11:38:38.637077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137549+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:38:39.137549+0000","last_peered":"2024-09-10T11:38:39.137549+0000","last_clean":"2024-09-10T11:38:39.137549+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:38:39.137549+0000","last_undegraded":"2024-09-10T11:38:39.137549+0000","last_fullsized":"2024-09-10T11:38:39.137549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638190+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:38:38.638190+0000","last_peered":"2024-09-10T11:38:38.638190+0000","last_clean":"2024-09-10T11:38:38.638190+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:38:38.638190+0000","last_undegraded":"2024-09-10T11:38:38.638190+0000","last_fullsized":"2024-09-10T11:38:38.638190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166762+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:38:39.166762+0000","last_peered":"2024-09-10T11:38:39.166762+0000","last_clean":"2024-09-10T11:38:39.166762+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:38:39.166762+0000","last_undegraded":"2024-09-10T11:38:39.166762+0000","last_fullsized":"2024-09-10T11:38:39.166762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165790+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:38:39.165790+0000","last_peered":"2024-09-10T11:38:39.165790+0000","last_clean":"2024-09-10T11:38:39.165790+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:38:39.165790+0000","last_undegraded":"2024-09-10T11:38:39.165790+0000","last_fullsized":"2024-09-10T11:38:39.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636602+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:38:37.636602+0000","last_peered":"2024-09-10T11:38:37.636602+0000","last_clean":"2024-09-10T11:38:37.636602+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:38:37.636602+0000","last_undegraded":"2024-09-10T11:38:37.636602+0000","last_fullsized":"2024-09-10T11:38:37.636602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634705+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:38:37.634705+0000","last_peered":"2024-09-10T11:38:37.634705+0000","last_clean":"2024-09-10T11:38:37.634705+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:38:37.634705+0000","last_undegraded":"2024-09-10T11:38:37.634705+0000","last_fullsized":"2024-09-10T11:38:37.634705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137451+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:38:39.137451+0000","last_peered":"2024-09-10T11:38:39.137451+0000","last_clean":"2024-09-10T11:38:39.137451+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:38:39.137451+0000","last_undegraded":"2024-09-10T11:38:39.137451+0000","last_fullsized":"2024-09-10T11:38:39.137451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634609+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:38:37.634609+0000","last_peered":"2024-09-10T11:38:37.634609+0000","last_clean":"2024-09-10T11:38:37.634609+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:38:37.634609+0000","last_undegraded":"2024-09-10T11:38:37.634609+0000","last_fullsized":"2024-09-10T11:38:37.634609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137860+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:38:39.137860+0000","last_peered":"2024-09-10T11:38:39.137860+0000","last_clean":"2024-09-10T11:38:39.137860+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:38:39.137860+0000","last_undegraded":"2024-09-10T11:38:39.137860+0000","last_fullsized":"2024-09-10T11:38:39.137860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166497+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:38:39.166497+0000","last_peered":"2024-09-10T11:38:39.166497+0000","last_clean":"2024-09-10T11:38:39.166497+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:38:39.166497+0000","last_undegraded":"2024-09-10T11:38:39.166497+0000","last_fullsized":"2024-09-10T11:38:39.166497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638081+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:38:38.638081+0000","last_peered":"2024-09-10T11:38:38.638081+0000","last_clean":"2024-09-10T11:38:38.638081+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:38:38.638081+0000","last_undegraded":"2024-09-10T11:38:38.638081+0000","last_fullsized":"2024-09-10T11:38:38.638081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637039+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:38:37.637039+0000","last_peered":"2024-09-10T11:38:37.637039+0000","last_clean":"2024-09-10T11:38:37.637039+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:38:37.637039+0000","last_undegraded":"2024-09-10T11:38:37.637039+0000","last_fullsized":"2024-09-10T11:38:37.637039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166074+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:38:39.166074+0000","last_peered":"2024-09-10T11:38:39.166074+0000","last_clean":"2024-09-10T11:38:39.166074+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:38:39.166074+0000","last_undegraded":"2024-09-10T11:38:39.166074+0000","last_fullsized":"2024-09-10T11:38:39.166074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636640+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:38:37.636640+0000","last_peered":"2024-09-10T11:38:37.636640+0000","last_clean":"2024-09-10T11:38:37.636640+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:38:37.636640+0000","last_undegraded":"2024-09-10T11:38:37.636640+0000","last_fullsized":"2024-09-10T11:38:37.636640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166462+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:38:39.166462+0000","last_peered":"2024-09-10T11:38:39.166462+0000","last_clean":"2024-09-10T11:38:39.166462+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:38:39.166462+0000","last_undegraded":"2024-09-10T11:38:39.166462+0000","last_fullsized":"2024-09-10T11:38:39.166462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165811+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:38:39.165811+0000","last_peered":"2024-09-10T11:38:39.165811+0000","last_clean":"2024-09-10T11:38:39.165811+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:38:39.165811+0000","last_undegraded":"2024-09-10T11:38:39.165811+0000","last_fullsized":"2024-09-10T11:38:39.165811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137626+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:38:39.137626+0000","last_peered":"2024-09-10T11:38:39.137626+0000","last_clean":"2024-09-10T11:38:39.137626+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:38:39.137626+0000","last_undegraded":"2024-09-10T11:38:39.137626+0000","last_fullsized":"2024-09-10T11:38:39.137626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.138032+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:38:39.138032+0000","last_peered":"2024-09-10T11:38:39.138032+0000","last_clean":"2024-09-10T11:38:39.138032+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:38:39.138032+0000","last_undegraded":"2024-09-10T11:38:39.138032+0000","last_fullsized":"2024-09-10T11:38:39.138032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166800+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:38:39.166800+0000","last_peered":"2024-09-10T11:38:39.166800+0000","last_clean":"2024-09-10T11:38:39.166800+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:38:39.166800+0000","last_undegraded":"2024-09-10T11:38:39.166800+0000","last_fullsized":"2024-09-10T11:38:39.166800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:40.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 -- 172.21.15.57:0/1538150181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c06f840 msgr2=0x7fad7c0ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 --2- 172.21.15.57:0/1538150181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c06f840 0x7fad7c0ae4d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 -- 172.21.15.57:0/1538150181 shutdown_connections 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 --2- 172.21.15.57:0/1538150181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad7c0b3dd0 0x7fad7c06f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 --2- 172.21.15.57:0/1538150181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c06f840 0x7fad7c0ae4d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 -- 172.21.15.57:0/1538150181 >> 172.21.15.57:0/1538150181 conn(0x7fad7c06c8d0 msgr2=0x7fad7c06cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:40.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 -- 172.21.15.57:0/1538150181 shutdown_connections 2024-09-10T11:38:40.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.364+0000 7fad82b0e640 1 -- 172.21.15.57:0/1538150181 wait complete. 2024-09-10T11:38:40.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.365+0000 7fad82b0e640 1 Processor -- start 2024-09-10T11:38:40.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.365+0000 7fad82b0e640 1 -- start start 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad82b0e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c06f840 0x7fad7c1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad82b0e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad7c0b39f0 0x7fad7c1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad82b0e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 0x7fad7c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad82b0e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0aeda0 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad82b0e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0aec20 con 0x7fad7c06f840 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad82b0e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c0aef20 con 0x7fad7c0b39f0 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad810ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 0x7fad7c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad810ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 0x7fad7c159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46476/0 (socket says 172.21.15.57:46476) 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad810ab640 1 -- 172.21.15.57:0/2740155834 learned_addr learned my addr 172.21.15.57:0/2740155834 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad7bfff640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad7c0b39f0 0x7fad7c1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.366+0000 7fad808aa640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c06f840 0x7fad7c1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad810ab640 1 -- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad7c0b39f0 msgr2=0x7fad7c1f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad810ab640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad7c0b39f0 0x7fad7c1f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad810ab640 1 -- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c06f840 msgr2=0x7fad7c1f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad810ab640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c06f840 0x7fad7c1f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad810ab640 1 -- 172.21.15.57:0/2740155834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c1f14c0 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad810ab640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 0x7fad7c159180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006010 tx=0x7fad6c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c03f070 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad6c005600 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c1f1770 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c035030 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.367+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c1f1d30 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.368+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c0ae4d0 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.369+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fad6c042070 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.369+0000 7fad797fa640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fad5c0750a0 0x7fad5c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.369+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad6c0b6ec0 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.369+0000 7fad808aa640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fad5c0750a0 0x7fad5c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.370+0000 7fad808aa640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fad5c0750a0 0x7fad5c077560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad740012e0 tx=0x7fad74009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.373+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fad6c080c60 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.592+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fad7c0cbef0 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.592+0000 7fad797fa640 1 -- 172.21.15.57:0/2740155834 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1315 (secure 0 0 0) 0x7fad6c085420 con 0x7fad7c0b3dd0 2024-09-10T11:38:40.593 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:40.593 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","health":{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1725968304,"num_in_osds":8,"osd_in_since":1725968294,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":91},{"state_name":"creating+peering","count":5},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241504256,"bytes_avail":772852609024,"bytes_total":773094113280,"unknown_pgs_ratio":0.93814432621002197,"inactive_pgs_ratio":0.051546391099691391},"fsmap":{"epoch":6,"btime":"2024-09-10T11:38:38:638948+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4368}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T11:38:11.564997+0000","services":{}},"progress_events":{}} 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fad5c0750a0 msgr2=0x7fad5c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fad5c0750a0 0x7fad5c077560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad740012e0 tx=0x7fad74009040 comp rx=0 tx=0).stop 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 msgr2=0x7fad7c159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 0x7fad7c159180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad6c006010 tx=0x7fad6c003820 comp rx=0 tx=0).stop 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 shutdown_connections 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fad5c0750a0 0x7fad5c077560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad7c0b3dd0 0x7fad7c159180 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad7c0b39f0 0x7fad7c1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 --2- 172.21.15.57:0/2740155834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad7c06f840 0x7fad7c1f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 >> 172.21.15.57:0/2740155834 conn(0x7fad7c06c8d0 msgr2=0x7fad7c15b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:40.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 shutdown_connections 2024-09-10T11:38:40.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.594+0000 7fad82b0e640 1 -- 172.21.15.57:0/2740155834 wait complete. 2024-09-10T11:38:40.605 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T11:38:40.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 -- 172.21.15.57:0/1361440709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d1940 msgr2=0x7f23980d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 --2- 172.21.15.57:0/1361440709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d1940 0x7f23980d3a20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f239808df60 tx=0x7f238002a4b0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 -- 172.21.15.57:0/1361440709 shutdown_connections 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 --2- 172.21.15.57:0/1361440709 >> v2:172.21.15.154:3300/0 conn(0x7f23980d3f60 0x7f23981617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 --2- 172.21.15.57:0/1361440709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d1940 0x7f23980d3a20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 --2- 172.21.15.57:0/1361440709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f239815dbf0 0x7f23980d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 -- 172.21.15.57:0/1361440709 >> 172.21.15.57:0/1361440709 conn(0x7f239808d6d0 msgr2=0x7f239809cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 -- 172.21.15.57:0/1361440709 shutdown_connections 2024-09-10T11:38:40.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.710+0000 7f239c850640 1 -- 172.21.15.57:0/1361440709 wait complete. 2024-09-10T11:38:40.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.711+0000 7f239c850640 1 Processor -- start 2024-09-10T11:38:40.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.711+0000 7f239c850640 1 -- start start 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239c850640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23980d1940 0x7f23980cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239c850640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 0x7f239815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239c850640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f239815dbf0 0x7f23981f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239c850640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2398161eb0 con 0x7f23980d3f60 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239c850640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2398161d30 con 0x7f23980d1940 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239c850640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2398162030 con 0x7f239815dbf0 2024-09-10T11:38:40.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 0x7f239815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 0x7f239815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46498/0 (socket says 172.21.15.57:46498) 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 -- 172.21.15.57:0/4284025788 learned_addr learned my addr 172.21.15.57:0/4284025788 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f239659c640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23980d1940 0x7f23980cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f2396d9d640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f239815dbf0 0x7f23981f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 -- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f239815dbf0 msgr2=0x7f23981f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f239815dbf0 0x7f23981f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 -- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23980d1940 msgr2=0x7f23980cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23980d1940 0x7f23980cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.712+0000 7f238ffff640 1 -- 172.21.15.57:0/4284025788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23981f8920 con 0x7f23980d3f60 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.713+0000 7f238ffff640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 0x7f239815fe20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23800099c0 tx=0x7f23800039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.713+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238003e030 con 0x7f23980d3f60 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.713+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23800047a0 con 0x7f23980d3f60 2024-09-10T11:38:40.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.713+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380035040 con 0x7f23980d3f60 2024-09-10T11:38:40.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.713+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2398160910 con 0x7f23980d3f60 2024-09-10T11:38:40.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.713+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2398160ed0 con 0x7f23980d3f60 2024-09-10T11:38:40.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.714+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2398162560 con 0x7f23980d3f60 2024-09-10T11:38:40.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.714+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2380041030 con 0x7f23980d3f60 2024-09-10T11:38:40.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.715+0000 7f238effd640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f23780750a0 0x7f2378077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:40.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.715+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23800b68e0 con 0x7f23980d3f60 2024-09-10T11:38:40.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.715+0000 7f239659c640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f23780750a0 0x7f2378077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:40.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.715+0000 7f239659c640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f23780750a0 0x7f2378077560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2388005fd0 tx=0x7f238800b390 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:40.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.719+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2380080680 con 0x7f23980d3f60 2024-09-10T11:38:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.874+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23981610a0 con 0x7f23780750a0 2024-09-10T11:38:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.878+0000 7f238effd640 1 -- 172.21.15.57:0/4284025788 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f23981610a0 con 0x7f23780750a0 2024-09-10T11:38:40.881 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f23780750a0 msgr2=0x7f2378077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f23780750a0 0x7f2378077560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2388005fd0 tx=0x7f238800b390 comp rx=0 tx=0).stop 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 msgr2=0x7f239815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 0x7f239815fe20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f23800099c0 tx=0x7f23800039e0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 shutdown_connections 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f23780750a0 0x7f2378077560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f239815dbf0 0x7f23981f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23980d3f60 0x7f239815fe20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 --2- 172.21.15.57:0/4284025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23980d1940 0x7f23980cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 >> 172.21.15.57:0/4284025788 conn(0x7f239808d6d0 msgr2=0x7f23980b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.881+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 shutdown_connections 2024-09-10T11:38:40.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:40.882+0000 7f239c850640 1 -- 172.21.15.57:0/4284025788 wait complete. 2024-09-10T11:38:40.893 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T11:38:40.190591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":2940928,"data_stored":1765196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.579926"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166415+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:38:39.166415+0000","last_peered":"2024-09-10T11:38:39.166415+0000","last_clean":"2024-09-10T11:38:39.166415+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:38:39.166415+0000","last_undegraded":"2024-09-10T11:38:39.166415+0000","last_fullsized":"2024-09-10T11:38:39.166415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634990+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:38:37.634990+0000","last_peered":"2024-09-10T11:38:37.634990+0000","last_clean":"2024-09-10T11:38:37.634990+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:38:37.634990+0000","last_undegraded":"2024-09-10T11:38:37.634990+0000","last_fullsized":"2024-09-10T11:38:37.634990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166638+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:38:39.166638+0000","last_peered":"2024-09-10T11:38:39.166638+0000","last_clean":"2024-09-10T11:38:39.166638+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:38:39.166638+0000","last_undegraded":"2024-09-10T11:38:39.166638+0000","last_fullsized":"2024-09-10T11:38:39.166638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636583+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:38:37.636583+0000","last_peered":"2024-09-10T11:38:37.636583+0000","last_clean":"2024-09-10T11:38:37.636583+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:38:37.636583+0000","last_undegraded":"2024-09-10T11:38:37.636583+0000","last_fullsized":"2024-09-10T11:38:37.636583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166387+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:38:39.166387+0000","last_peered":"2024-09-10T11:38:39.166387+0000","last_clean":"2024-09-10T11:38:39.166387+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:38:39.166387+0000","last_undegraded":"2024-09-10T11:38:39.166387+0000","last_fullsized":"2024-09-10T11:38:39.166387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637139+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:38:37.637139+0000","last_peered":"2024-09-10T11:38:37.637139+0000","last_clean":"2024-09-10T11:38:37.637139+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:38:37.637139+0000","last_undegraded":"2024-09-10T11:38:37.637139+0000","last_fullsized":"2024-09-10T11:38:37.637139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165949+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:38:39.165949+0000","last_peered":"2024-09-10T11:38:39.165949+0000","last_clean":"2024-09-10T11:38:39.165949+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:38:39.165949+0000","last_undegraded":"2024-09-10T11:38:39.165949+0000","last_fullsized":"2024-09-10T11:38:39.165949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137244+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:38:39.137244+0000","last_peered":"2024-09-10T11:38:39.137244+0000","last_clean":"2024-09-10T11:38:39.137244+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:38:39.137244+0000","last_undegraded":"2024-09-10T11:38:39.137244+0000","last_fullsized":"2024-09-10T11:38:39.137244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166432+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:38:39.166432+0000","last_peered":"2024-09-10T11:38:39.166432+0000","last_clean":"2024-09-10T11:38:39.166432+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:38:39.166432+0000","last_undegraded":"2024-09-10T11:38:39.166432+0000","last_fullsized":"2024-09-10T11:38:39.166432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638355+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:38:38.638355+0000","last_peered":"2024-09-10T11:38:38.638355+0000","last_clean":"2024-09-10T11:38:38.638355+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:38:38.638355+0000","last_undegraded":"2024-09-10T11:38:38.638355+0000","last_fullsized":"2024-09-10T11:38:38.638355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638239+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:38:38.638239+0000","last_peered":"2024-09-10T11:38:38.638239+0000","last_clean":"2024-09-10T11:38:38.638239+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:38:38.638239+0000","last_undegraded":"2024-09-10T11:38:38.638239+0000","last_fullsized":"2024-09-10T11:38:38.638239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637846+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:38:37.637846+0000","last_peered":"2024-09-10T11:38:37.637846+0000","last_clean":"2024-09-10T11:38:37.637846+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:38:37.637846+0000","last_undegraded":"2024-09-10T11:38:37.637846+0000","last_fullsized":"2024-09-10T11:38:37.637846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137648+0000","last_change":"2024-09-10T11:38:36.649867+0000","last_active":"2024-09-10T11:38:39.137648+0000","last_peered":"2024-09-10T11:38:39.137648+0000","last_clean":"2024-09-10T11:38:39.137648+0000","last_became_active":"2024-09-10T11:38:36.648237+0000","last_became_peered":"2024-09-10T11:38:36.648237+0000","last_unstale":"2024-09-10T11:38:39.137648+0000","last_undegraded":"2024-09-10T11:38:39.137648+0000","last_fullsized":"2024-09-10T11:38:39.137648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166145+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:38:39.166145+0000","last_peered":"2024-09-10T11:38:39.166145+0000","last_clean":"2024-09-10T11:38:39.166145+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:38:39.166145+0000","last_undegraded":"2024-09-10T11:38:39.166145+0000","last_fullsized":"2024-09-10T11:38:39.166145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634591+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:38:37.634591+0000","last_peered":"2024-09-10T11:38:37.634591+0000","last_clean":"2024-09-10T11:38:37.634591+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:38:37.634591+0000","last_undegraded":"2024-09-10T11:38:37.634591+0000","last_fullsized":"2024-09-10T11:38:37.634591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636309+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:38:37.636309+0000","last_peered":"2024-09-10T11:38:37.636309+0000","last_clean":"2024-09-10T11:38:37.636309+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:38:37.636309+0000","last_undegraded":"2024-09-10T11:38:37.636309+0000","last_fullsized":"2024-09-10T11:38:37.636309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637255+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:38:37.637255+0000","last_peered":"2024-09-10T11:38:37.637255+0000","last_clean":"2024-09-10T11:38:37.637255+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:38:37.637255+0000","last_undegraded":"2024-09-10T11:38:37.637255+0000","last_fullsized":"2024-09-10T11:38:37.637255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165966+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:38:39.165966+0000","last_peered":"2024-09-10T11:38:39.165966+0000","last_clean":"2024-09-10T11:38:39.165966+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:38:39.165966+0000","last_undegraded":"2024-09-10T11:38:39.165966+0000","last_fullsized":"2024-09-10T11:38:39.165966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166663+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:38:39.166663+0000","last_peered":"2024-09-10T11:38:39.166663+0000","last_clean":"2024-09-10T11:38:39.166663+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:38:39.166663+0000","last_undegraded":"2024-09-10T11:38:39.166663+0000","last_fullsized":"2024-09-10T11:38:39.166663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638287+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:38:38.638287+0000","last_peered":"2024-09-10T11:38:38.638287+0000","last_clean":"2024-09-10T11:38:38.638287+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:38:38.638287+0000","last_undegraded":"2024-09-10T11:38:38.638287+0000","last_fullsized":"2024-09-10T11:38:38.638287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166357+0000","last_change":"2024-09-10T11:38:36.643946+0000","last_active":"2024-09-10T11:38:39.166357+0000","last_peered":"2024-09-10T11:38:39.166357+0000","last_clean":"2024-09-10T11:38:39.166357+0000","last_became_active":"2024-09-10T11:38:36.643648+0000","last_became_peered":"2024-09-10T11:38:36.643648+0000","last_unstale":"2024-09-10T11:38:39.166357+0000","last_undegraded":"2024-09-10T11:38:39.166357+0000","last_fullsized":"2024-09-10T11:38:39.166357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637479+0000","last_change":"2024-09-10T11:38:36.643116+0000","last_active":"2024-09-10T11:38:37.637479+0000","last_peered":"2024-09-10T11:38:37.637479+0000","last_clean":"2024-09-10T11:38:37.637479+0000","last_became_active":"2024-09-10T11:38:36.642805+0000","last_became_peered":"2024-09-10T11:38:36.642805+0000","last_unstale":"2024-09-10T11:38:37.637479+0000","last_undegraded":"2024-09-10T11:38:37.637479+0000","last_fullsized":"2024-09-10T11:38:37.637479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:53.917503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137290+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:38:39.137290+0000","last_peered":"2024-09-10T11:38:39.137290+0000","last_clean":"2024-09-10T11:38:39.137290+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:38:39.137290+0000","last_undegraded":"2024-09-10T11:38:39.137290+0000","last_fullsized":"2024-09-10T11:38:39.137290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636477+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:38:37.636477+0000","last_peered":"2024-09-10T11:38:37.636477+0000","last_clean":"2024-09-10T11:38:37.636477+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:38:37.636477+0000","last_undegraded":"2024-09-10T11:38:37.636477+0000","last_fullsized":"2024-09-10T11:38:37.636477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137797+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:38:39.137797+0000","last_peered":"2024-09-10T11:38:39.137797+0000","last_clean":"2024-09-10T11:38:39.137797+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:38:39.137797+0000","last_undegraded":"2024-09-10T11:38:39.137797+0000","last_fullsized":"2024-09-10T11:38:39.137797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638350+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:38:38.638350+0000","last_peered":"2024-09-10T11:38:38.638350+0000","last_clean":"2024-09-10T11:38:38.638350+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:38:38.638350+0000","last_undegraded":"2024-09-10T11:38:38.638350+0000","last_fullsized":"2024-09-10T11:38:38.638350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634892+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:38:37.634892+0000","last_peered":"2024-09-10T11:38:37.634892+0000","last_clean":"2024-09-10T11:38:37.634892+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:38:37.634892+0000","last_undegraded":"2024-09-10T11:38:37.634892+0000","last_fullsized":"2024-09-10T11:38:37.634892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137925+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:38:39.137925+0000","last_peered":"2024-09-10T11:38:39.137925+0000","last_clean":"2024-09-10T11:38:39.137925+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:38:39.137925+0000","last_undegraded":"2024-09-10T11:38:39.137925+0000","last_fullsized":"2024-09-10T11:38:39.137925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166405+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:38:39.166405+0000","last_peered":"2024-09-10T11:38:39.166405+0000","last_clean":"2024-09-10T11:38:39.166405+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:38:39.166405+0000","last_undegraded":"2024-09-10T11:38:39.166405+0000","last_fullsized":"2024-09-10T11:38:39.166405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637858+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:38:37.637858+0000","last_peered":"2024-09-10T11:38:37.637858+0000","last_clean":"2024-09-10T11:38:37.637858+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:38:37.637858+0000","last_undegraded":"2024-09-10T11:38:37.637858+0000","last_fullsized":"2024-09-10T11:38:37.637858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165985+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:38:39.165985+0000","last_peered":"2024-09-10T11:38:39.165985+0000","last_clean":"2024-09-10T11:38:39.165985+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:38:39.165985+0000","last_undegraded":"2024-09-10T11:38:39.165985+0000","last_fullsized":"2024-09-10T11:38:39.165985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638232+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:38:38.638232+0000","last_peered":"2024-09-10T11:38:38.638232+0000","last_clean":"2024-09-10T11:38:38.638232+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:38:38.638232+0000","last_undegraded":"2024-09-10T11:38:38.638232+0000","last_fullsized":"2024-09-10T11:38:38.638232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636281+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:38:37.636281+0000","last_peered":"2024-09-10T11:38:37.636281+0000","last_clean":"2024-09-10T11:38:37.636281+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:38:37.636281+0000","last_undegraded":"2024-09-10T11:38:37.636281+0000","last_fullsized":"2024-09-10T11:38:37.636281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137814+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:38:39.137814+0000","last_peered":"2024-09-10T11:38:39.137814+0000","last_clean":"2024-09-10T11:38:39.137814+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:38:39.137814+0000","last_undegraded":"2024-09-10T11:38:39.137814+0000","last_fullsized":"2024-09-10T11:38:39.137814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166662+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:38:39.166662+0000","last_peered":"2024-09-10T11:38:39.166662+0000","last_clean":"2024-09-10T11:38:39.166662+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:38:39.166662+0000","last_undegraded":"2024-09-10T11:38:39.166662+0000","last_fullsized":"2024-09-10T11:38:39.166662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637823+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:38:38.637823+0000","last_peered":"2024-09-10T11:38:38.637823+0000","last_clean":"2024-09-10T11:38:38.637823+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:38:38.637823+0000","last_undegraded":"2024-09-10T11:38:38.637823+0000","last_fullsized":"2024-09-10T11:38:38.637823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137316+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:38:39.137316+0000","last_peered":"2024-09-10T11:38:39.137316+0000","last_clean":"2024-09-10T11:38:39.137316+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:38:39.137316+0000","last_undegraded":"2024-09-10T11:38:39.137316+0000","last_fullsized":"2024-09-10T11:38:39.137316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137319+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:38:39.137319+0000","last_peered":"2024-09-10T11:38:39.137319+0000","last_clean":"2024-09-10T11:38:39.137319+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:38:39.137319+0000","last_undegraded":"2024-09-10T11:38:39.137319+0000","last_fullsized":"2024-09-10T11:38:39.137319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636420+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:38:37.636420+0000","last_peered":"2024-09-10T11:38:37.636420+0000","last_clean":"2024-09-10T11:38:37.636420+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:38:37.636420+0000","last_undegraded":"2024-09-10T11:38:37.636420+0000","last_fullsized":"2024-09-10T11:38:37.636420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634585+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:38:37.634585+0000","last_peered":"2024-09-10T11:38:37.634585+0000","last_clean":"2024-09-10T11:38:37.634585+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:38:37.634585+0000","last_undegraded":"2024-09-10T11:38:37.634585+0000","last_fullsized":"2024-09-10T11:38:37.634585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638124+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:38:38.638124+0000","last_peered":"2024-09-10T11:38:38.638124+0000","last_clean":"2024-09-10T11:38:38.638124+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:38:38.638124+0000","last_undegraded":"2024-09-10T11:38:38.638124+0000","last_fullsized":"2024-09-10T11:38:38.638124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636901+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:38:37.636901+0000","last_peered":"2024-09-10T11:38:37.636901+0000","last_clean":"2024-09-10T11:38:37.636901+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:38:37.636901+0000","last_undegraded":"2024-09-10T11:38:37.636901+0000","last_fullsized":"2024-09-10T11:38:37.636901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636860+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:38:37.636860+0000","last_peered":"2024-09-10T11:38:37.636860+0000","last_clean":"2024-09-10T11:38:37.636860+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:38:37.636860+0000","last_undegraded":"2024-09-10T11:38:37.636860+0000","last_fullsized":"2024-09-10T11:38:37.636860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166003+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:38:39.166003+0000","last_peered":"2024-09-10T11:38:39.166003+0000","last_clean":"2024-09-10T11:38:39.166003+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:38:39.166003+0000","last_undegraded":"2024-09-10T11:38:39.166003+0000","last_fullsized":"2024-09-10T11:38:39.166003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634824+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:38:37.634824+0000","last_peered":"2024-09-10T11:38:37.634824+0000","last_clean":"2024-09-10T11:38:37.634824+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:38:37.634824+0000","last_undegraded":"2024-09-10T11:38:37.634824+0000","last_fullsized":"2024-09-10T11:38:37.634824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637941+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:38:37.637941+0000","last_peered":"2024-09-10T11:38:37.637941+0000","last_clean":"2024-09-10T11:38:37.637941+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:38:37.637941+0000","last_undegraded":"2024-09-10T11:38:37.637941+0000","last_fullsized":"2024-09-10T11:38:37.637941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637984+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:38:38.637984+0000","last_peered":"2024-09-10T11:38:38.637984+0000","last_clean":"2024-09-10T11:38:38.637984+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:38:38.637984+0000","last_undegraded":"2024-09-10T11:38:38.637984+0000","last_fullsized":"2024-09-10T11:38:38.637984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166328+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:38:39.166328+0000","last_peered":"2024-09-10T11:38:39.166328+0000","last_clean":"2024-09-10T11:38:39.166328+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:38:39.166328+0000","last_undegraded":"2024-09-10T11:38:39.166328+0000","last_fullsized":"2024-09-10T11:38:39.166328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166556+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:38:39.166556+0000","last_peered":"2024-09-10T11:38:39.166556+0000","last_clean":"2024-09-10T11:38:39.166556+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:38:39.166556+0000","last_undegraded":"2024-09-10T11:38:39.166556+0000","last_fullsized":"2024-09-10T11:38:39.166556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166356+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:38:39.166356+0000","last_peered":"2024-09-10T11:38:39.166356+0000","last_clean":"2024-09-10T11:38:39.166356+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:38:39.166356+0000","last_undegraded":"2024-09-10T11:38:39.166356+0000","last_fullsized":"2024-09-10T11:38:39.166356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637603+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:38:37.637603+0000","last_peered":"2024-09-10T11:38:37.637603+0000","last_clean":"2024-09-10T11:38:37.637603+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:38:37.637603+0000","last_undegraded":"2024-09-10T11:38:37.637603+0000","last_fullsized":"2024-09-10T11:38:37.637603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166332+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:38:39.166332+0000","last_peered":"2024-09-10T11:38:39.166332+0000","last_clean":"2024-09-10T11:38:39.166332+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:38:39.166332+0000","last_undegraded":"2024-09-10T11:38:39.166332+0000","last_fullsized":"2024-09-10T11:38:39.166332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637806+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:38:38.637806+0000","last_peered":"2024-09-10T11:38:38.637806+0000","last_clean":"2024-09-10T11:38:38.637806+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:38:38.637806+0000","last_undegraded":"2024-09-10T11:38:38.637806+0000","last_fullsized":"2024-09-10T11:38:38.637806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638020+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:38:38.638020+0000","last_peered":"2024-09-10T11:38:38.638020+0000","last_clean":"2024-09-10T11:38:38.638020+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:38:38.638020+0000","last_undegraded":"2024-09-10T11:38:38.638020+0000","last_fullsized":"2024-09-10T11:38:38.638020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165609+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:38:39.165609+0000","last_peered":"2024-09-10T11:38:39.165609+0000","last_clean":"2024-09-10T11:38:39.165609+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:38:39.165609+0000","last_undegraded":"2024-09-10T11:38:39.165609+0000","last_fullsized":"2024-09-10T11:38:39.165609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166134+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:38:39.166134+0000","last_peered":"2024-09-10T11:38:39.166134+0000","last_clean":"2024-09-10T11:38:39.166134+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:38:39.166134+0000","last_undegraded":"2024-09-10T11:38:39.166134+0000","last_fullsized":"2024-09-10T11:38:39.166134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637534+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:38:37.637534+0000","last_peered":"2024-09-10T11:38:37.637534+0000","last_clean":"2024-09-10T11:38:37.637534+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:38:37.637534+0000","last_undegraded":"2024-09-10T11:38:37.637534+0000","last_fullsized":"2024-09-10T11:38:37.637534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166467+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:38:39.166467+0000","last_peered":"2024-09-10T11:38:39.166467+0000","last_clean":"2024-09-10T11:38:39.166467+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:38:39.166467+0000","last_undegraded":"2024-09-10T11:38:39.166467+0000","last_fullsized":"2024-09-10T11:38:39.166467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166064+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:38:39.166064+0000","last_peered":"2024-09-10T11:38:39.166064+0000","last_clean":"2024-09-10T11:38:39.166064+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:38:39.166064+0000","last_undegraded":"2024-09-10T11:38:39.166064+0000","last_fullsized":"2024-09-10T11:38:39.166064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166661+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:38:39.166661+0000","last_peered":"2024-09-10T11:38:39.166661+0000","last_clean":"2024-09-10T11:38:39.166661+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:38:39.166661+0000","last_undegraded":"2024-09-10T11:38:39.166661+0000","last_fullsized":"2024-09-10T11:38:39.166661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634985+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:38:37.634985+0000","last_peered":"2024-09-10T11:38:37.634985+0000","last_clean":"2024-09-10T11:38:37.634985+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:38:37.634985+0000","last_undegraded":"2024-09-10T11:38:37.634985+0000","last_fullsized":"2024-09-10T11:38:37.634985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636810+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:38:37.636810+0000","last_peered":"2024-09-10T11:38:37.636810+0000","last_clean":"2024-09-10T11:38:37.636810+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:38:37.636810+0000","last_undegraded":"2024-09-10T11:38:37.636810+0000","last_fullsized":"2024-09-10T11:38:37.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165675+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:38:39.165675+0000","last_peered":"2024-09-10T11:38:39.165675+0000","last_clean":"2024-09-10T11:38:39.165675+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:38:39.165675+0000","last_undegraded":"2024-09-10T11:38:39.165675+0000","last_fullsized":"2024-09-10T11:38:39.165675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166382+0000","last_change":"2024-09-10T11:38:36.653163+0000","last_active":"2024-09-10T11:38:39.166382+0000","last_peered":"2024-09-10T11:38:39.166382+0000","last_clean":"2024-09-10T11:38:39.166382+0000","last_became_active":"2024-09-10T11:38:36.652861+0000","last_became_peered":"2024-09-10T11:38:36.652861+0000","last_unstale":"2024-09-10T11:38:39.166382+0000","last_undegraded":"2024-09-10T11:38:39.166382+0000","last_fullsized":"2024-09-10T11:38:39.166382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165892+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:39.165892+0000","last_peered":"2024-09-10T11:38:39.165892+0000","last_clean":"2024-09-10T11:38:39.165892+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:39.165892+0000","last_undegraded":"2024-09-10T11:38:39.165892+0000","last_fullsized":"2024-09-10T11:38:39.165892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636247+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:38:37.636247+0000","last_peered":"2024-09-10T11:38:37.636247+0000","last_clean":"2024-09-10T11:38:37.636247+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:38:37.636247+0000","last_undegraded":"2024-09-10T11:38:37.636247+0000","last_fullsized":"2024-09-10T11:38:37.636247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137684+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:38:39.137684+0000","last_peered":"2024-09-10T11:38:39.137684+0000","last_clean":"2024-09-10T11:38:39.137684+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:38:39.137684+0000","last_undegraded":"2024-09-10T11:38:39.137684+0000","last_fullsized":"2024-09-10T11:38:39.137684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166230+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:38:39.166230+0000","last_peered":"2024-09-10T11:38:39.166230+0000","last_clean":"2024-09-10T11:38:39.166230+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:38:39.166230+0000","last_undegraded":"2024-09-10T11:38:39.166230+0000","last_fullsized":"2024-09-10T11:38:39.166230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165865+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:38:39.165865+0000","last_peered":"2024-09-10T11:38:39.165865+0000","last_clean":"2024-09-10T11:38:39.165865+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:38:39.165865+0000","last_undegraded":"2024-09-10T11:38:39.165865+0000","last_fullsized":"2024-09-10T11:38:39.165865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166086+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:38:39.166086+0000","last_peered":"2024-09-10T11:38:39.166086+0000","last_clean":"2024-09-10T11:38:39.166086+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:38:39.166086+0000","last_undegraded":"2024-09-10T11:38:39.166086+0000","last_fullsized":"2024-09-10T11:38:39.166086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634619+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:38:37.634619+0000","last_peered":"2024-09-10T11:38:37.634619+0000","last_clean":"2024-09-10T11:38:37.634619+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:38:37.634619+0000","last_undegraded":"2024-09-10T11:38:37.634619+0000","last_fullsized":"2024-09-10T11:38:37.634619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637700+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:38:37.637700+0000","last_peered":"2024-09-10T11:38:37.637700+0000","last_clean":"2024-09-10T11:38:37.637700+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:38:37.637700+0000","last_undegraded":"2024-09-10T11:38:37.637700+0000","last_fullsized":"2024-09-10T11:38:37.637700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637363+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:38:37.637363+0000","last_peered":"2024-09-10T11:38:37.637363+0000","last_clean":"2024-09-10T11:38:37.637363+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:38:37.637363+0000","last_undegraded":"2024-09-10T11:38:37.637363+0000","last_fullsized":"2024-09-10T11:38:37.637363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634761+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:38:37.634761+0000","last_peered":"2024-09-10T11:38:37.634761+0000","last_clean":"2024-09-10T11:38:37.634761+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:38:37.634761+0000","last_undegraded":"2024-09-10T11:38:37.634761+0000","last_fullsized":"2024-09-10T11:38:37.634761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636997+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:38:37.636997+0000","last_peered":"2024-09-10T11:38:37.636997+0000","last_clean":"2024-09-10T11:38:37.636997+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:38:37.636997+0000","last_undegraded":"2024-09-10T11:38:37.636997+0000","last_fullsized":"2024-09-10T11:38:37.636997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166586+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:38:39.166586+0000","last_peered":"2024-09-10T11:38:39.166586+0000","last_clean":"2024-09-10T11:38:39.166586+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:38:39.166586+0000","last_undegraded":"2024-09-10T11:38:39.166586+0000","last_fullsized":"2024-09-10T11:38:39.166586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634718+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:38:37.634718+0000","last_peered":"2024-09-10T11:38:37.634718+0000","last_clean":"2024-09-10T11:38:37.634718+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:38:37.634718+0000","last_undegraded":"2024-09-10T11:38:37.634718+0000","last_fullsized":"2024-09-10T11:38:37.634718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637077+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:38:38.637077+0000","last_peered":"2024-09-10T11:38:38.637077+0000","last_clean":"2024-09-10T11:38:38.637077+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:38:38.637077+0000","last_undegraded":"2024-09-10T11:38:38.637077+0000","last_fullsized":"2024-09-10T11:38:38.637077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137549+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:38:39.137549+0000","last_peered":"2024-09-10T11:38:39.137549+0000","last_clean":"2024-09-10T11:38:39.137549+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:38:39.137549+0000","last_undegraded":"2024-09-10T11:38:39.137549+0000","last_fullsized":"2024-09-10T11:38:39.137549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638190+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:38:38.638190+0000","last_peered":"2024-09-10T11:38:38.638190+0000","last_clean":"2024-09-10T11:38:38.638190+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:38:38.638190+0000","last_undegraded":"2024-09-10T11:38:38.638190+0000","last_fullsized":"2024-09-10T11:38:38.638190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166762+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:38:39.166762+0000","last_peered":"2024-09-10T11:38:39.166762+0000","last_clean":"2024-09-10T11:38:39.166762+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:38:39.166762+0000","last_undegraded":"2024-09-10T11:38:39.166762+0000","last_fullsized":"2024-09-10T11:38:39.166762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165790+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:38:39.165790+0000","last_peered":"2024-09-10T11:38:39.165790+0000","last_clean":"2024-09-10T11:38:39.165790+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:38:39.165790+0000","last_undegraded":"2024-09-10T11:38:39.165790+0000","last_fullsized":"2024-09-10T11:38:39.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636602+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:38:37.636602+0000","last_peered":"2024-09-10T11:38:37.636602+0000","last_clean":"2024-09-10T11:38:37.636602+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:38:37.636602+0000","last_undegraded":"2024-09-10T11:38:37.636602+0000","last_fullsized":"2024-09-10T11:38:37.636602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634705+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:38:37.634705+0000","last_peered":"2024-09-10T11:38:37.634705+0000","last_clean":"2024-09-10T11:38:37.634705+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:38:37.634705+0000","last_undegraded":"2024-09-10T11:38:37.634705+0000","last_fullsized":"2024-09-10T11:38:37.634705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137451+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:38:39.137451+0000","last_peered":"2024-09-10T11:38:39.137451+0000","last_clean":"2024-09-10T11:38:39.137451+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:38:39.137451+0000","last_undegraded":"2024-09-10T11:38:39.137451+0000","last_fullsized":"2024-09-10T11:38:39.137451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634609+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:38:37.634609+0000","last_peered":"2024-09-10T11:38:37.634609+0000","last_clean":"2024-09-10T11:38:37.634609+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:38:37.634609+0000","last_undegraded":"2024-09-10T11:38:37.634609+0000","last_fullsized":"2024-09-10T11:38:37.634609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137860+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:38:39.137860+0000","last_peered":"2024-09-10T11:38:39.137860+0000","last_clean":"2024-09-10T11:38:39.137860+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:38:39.137860+0000","last_undegraded":"2024-09-10T11:38:39.137860+0000","last_fullsized":"2024-09-10T11:38:39.137860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166497+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:38:39.166497+0000","last_peered":"2024-09-10T11:38:39.166497+0000","last_clean":"2024-09-10T11:38:39.166497+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:38:39.166497+0000","last_undegraded":"2024-09-10T11:38:39.166497+0000","last_fullsized":"2024-09-10T11:38:39.166497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638081+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:38:38.638081+0000","last_peered":"2024-09-10T11:38:38.638081+0000","last_clean":"2024-09-10T11:38:38.638081+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:38:38.638081+0000","last_undegraded":"2024-09-10T11:38:38.638081+0000","last_fullsized":"2024-09-10T11:38:38.638081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637039+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:38:37.637039+0000","last_peered":"2024-09-10T11:38:37.637039+0000","last_clean":"2024-09-10T11:38:37.637039+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:38:37.637039+0000","last_undegraded":"2024-09-10T11:38:37.637039+0000","last_fullsized":"2024-09-10T11:38:37.637039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166074+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:38:39.166074+0000","last_peered":"2024-09-10T11:38:39.166074+0000","last_clean":"2024-09-10T11:38:39.166074+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:38:39.166074+0000","last_undegraded":"2024-09-10T11:38:39.166074+0000","last_fullsized":"2024-09-10T11:38:39.166074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636640+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:38:37.636640+0000","last_peered":"2024-09-10T11:38:37.636640+0000","last_clean":"2024-09-10T11:38:37.636640+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:38:37.636640+0000","last_undegraded":"2024-09-10T11:38:37.636640+0000","last_fullsized":"2024-09-10T11:38:37.636640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166462+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:38:39.166462+0000","last_peered":"2024-09-10T11:38:39.166462+0000","last_clean":"2024-09-10T11:38:39.166462+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:38:39.166462+0000","last_undegraded":"2024-09-10T11:38:39.166462+0000","last_fullsized":"2024-09-10T11:38:39.166462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165811+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:38:39.165811+0000","last_peered":"2024-09-10T11:38:39.165811+0000","last_clean":"2024-09-10T11:38:39.165811+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:38:39.165811+0000","last_undegraded":"2024-09-10T11:38:39.165811+0000","last_fullsized":"2024-09-10T11:38:39.165811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137626+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:38:39.137626+0000","last_peered":"2024-09-10T11:38:39.137626+0000","last_clean":"2024-09-10T11:38:39.137626+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:38:39.137626+0000","last_undegraded":"2024-09-10T11:38:39.137626+0000","last_fullsized":"2024-09-10T11:38:39.137626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.138032+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:38:39.138032+0000","last_peered":"2024-09-10T11:38:39.138032+0000","last_clean":"2024-09-10T11:38:39.138032+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:38:39.138032+0000","last_undegraded":"2024-09-10T11:38:39.138032+0000","last_fullsized":"2024-09-10T11:38:39.138032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166800+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:38:39.166800+0000","last_peered":"2024-09-10T11:38:39.166800+0000","last_clean":"2024-09-10T11:38:39.166800+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:38:39.166800+0000","last_undegraded":"2024-09-10T11:38:39.166800+0000","last_fullsized":"2024-09-10T11:38:39.166800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:41.590 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-09-10T11:38:41.589+0000 7f67f337d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T11:38:43.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:44.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 -- 172.21.15.57:0/240371450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a015dbf0 msgr2=0x7f14a00d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 --2- 172.21.15.57:0/240371450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a015dbf0 0x7f14a00d10d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1494009830 tx=0x7f149402a510 comp rx=0 tx=0).stop 2024-09-10T11:38:44.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 -- 172.21.15.57:0/240371450 shutdown_connections 2024-09-10T11:38:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 --2- 172.21.15.57:0/240371450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14a00d4130 0x7f14a00cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 --2- 172.21.15.57:0/240371450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a015dbf0 0x7f14a00d10d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 -- 172.21.15.57:0/240371450 >> 172.21.15.57:0/240371450 conn(0x7f14a008d6d0 msgr2=0x7f14a009cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 -- 172.21.15.57:0/240371450 shutdown_connections 2024-09-10T11:38:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.015+0000 7f14a7218640 1 -- 172.21.15.57:0/240371450 wait complete. 2024-09-10T11:38:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.016+0000 7f14a7218640 1 Processor -- start 2024-09-10T11:38:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.016+0000 7f14a7218640 1 -- start start 2024-09-10T11:38:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a7218640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 0x7f14a014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a7218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14a00d4130 0x7f14a009da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a7218640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14a015dbf0 0x7f14a014e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a7218640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00cf2e0 con 0x7f14a00d1940 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a7218640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00cf160 con 0x7f14a00d4130 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a7218640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f14a00cf460 con 0x7f14a015dbf0 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a4fb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 0x7f14a014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a4fb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 0x7f14a014ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46518/0 (socket says 172.21.15.57:46518) 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a4fb4640 1 -- 172.21.15.57:0/3033377940 learned_addr learned my addr 172.21.15.57:0/3033377940 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f14a57b5640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14a015dbf0 0x7f14a014e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.017+0000 7f149ffff640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14a00d4130 0x7f14a009da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a4fb4640 1 -- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14a015dbf0 msgr2=0x7f14a014e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a4fb4640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14a015dbf0 0x7f14a014e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a4fb4640 1 -- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14a00d4130 msgr2=0x7f14a009da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a4fb4640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14a00d4130 0x7f14a009da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a4fb4640 1 -- 172.21.15.57:0/3033377940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a00ce180 con 0x7f14a00d1940 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a4fb4640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 0x7f14a014ddf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1494000c00 tx=0x7f1494032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494040070 con 0x7f14a00d1940 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14940038e0 con 0x7f14a00d1940 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a00cb470 con 0x7f14a00d1940 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494005c90 con 0x7f14a00d1940 2024-09-10T11:38:44.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.018+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a00cb710 con 0x7f14a00d1940 2024-09-10T11:38:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.019+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a00cf9f0 con 0x7f14a00d1940 2024-09-10T11:38:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.020+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f1494039040 con 0x7f14a00d1940 2024-09-10T11:38:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.020+0000 7f149d7fa640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f14840750a0 0x7f1484077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.020+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f14940b7760 con 0x7f14a00d1940 2024-09-10T11:38:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.021+0000 7f149ffff640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f14840750a0 0x7f1484077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.021+0000 7f149ffff640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f14840750a0 0x7f1484077560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14a00ca440 tx=0x7f148c009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.024+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f1494081b50 con 0x7f14a00d1940 2024-09-10T11:38:44.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.181+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14a00b9cf0 con 0x7f14840750a0 2024-09-10T11:38:44.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.186+0000 7f149d7fa640 1 -- 172.21.15.57:0/3033377940 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f14a00b9cf0 con 0x7f14840750a0 2024-09-10T11:38:44.189 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:44.191 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:44.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f14840750a0 msgr2=0x7f1484077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f14840750a0 0x7f1484077560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14a00ca440 tx=0x7f148c009040 comp rx=0 tx=0).stop 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 msgr2=0x7f14a014ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 0x7f14a014ddf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1494000c00 tx=0x7f1494032c10 comp rx=0 tx=0).stop 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 shutdown_connections 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f14840750a0 0x7f1484077560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14a015dbf0 0x7f14a014e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14a00d4130 0x7f14a009da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 --2- 172.21.15.57:0/3033377940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a00d1940 0x7f14a014ddf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 >> 172.21.15.57:0/3033377940 conn(0x7f14a008d6d0 msgr2=0x7f14a00d37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 shutdown_connections 2024-09-10T11:38:44.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.189+0000 7f14a7218640 1 -- 172.21.15.57:0/3033377940 wait complete. 2024-09-10T11:38:44.201 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T11:38:42.191143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235760,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738960,"statfs":{"total":773094113280,"available":772852695040,"internally_reserved":0,"allocated":2940928,"data_stored":1765196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.571523"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166415+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:38:39.166415+0000","last_peered":"2024-09-10T11:38:39.166415+0000","last_clean":"2024-09-10T11:38:39.166415+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:38:39.166415+0000","last_undegraded":"2024-09-10T11:38:39.166415+0000","last_fullsized":"2024-09-10T11:38:39.166415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634990+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:38:37.634990+0000","last_peered":"2024-09-10T11:38:37.634990+0000","last_clean":"2024-09-10T11:38:37.634990+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:38:37.634990+0000","last_undegraded":"2024-09-10T11:38:37.634990+0000","last_fullsized":"2024-09-10T11:38:37.634990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166638+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:38:39.166638+0000","last_peered":"2024-09-10T11:38:39.166638+0000","last_clean":"2024-09-10T11:38:39.166638+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:38:39.166638+0000","last_undegraded":"2024-09-10T11:38:39.166638+0000","last_fullsized":"2024-09-10T11:38:39.166638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636583+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:38:37.636583+0000","last_peered":"2024-09-10T11:38:37.636583+0000","last_clean":"2024-09-10T11:38:37.636583+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:38:37.636583+0000","last_undegraded":"2024-09-10T11:38:37.636583+0000","last_fullsized":"2024-09-10T11:38:37.636583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166387+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:38:39.166387+0000","last_peered":"2024-09-10T11:38:39.166387+0000","last_clean":"2024-09-10T11:38:39.166387+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:38:39.166387+0000","last_undegraded":"2024-09-10T11:38:39.166387+0000","last_fullsized":"2024-09-10T11:38:39.166387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637139+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:38:37.637139+0000","last_peered":"2024-09-10T11:38:37.637139+0000","last_clean":"2024-09-10T11:38:37.637139+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:38:37.637139+0000","last_undegraded":"2024-09-10T11:38:37.637139+0000","last_fullsized":"2024-09-10T11:38:37.637139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165949+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:38:39.165949+0000","last_peered":"2024-09-10T11:38:39.165949+0000","last_clean":"2024-09-10T11:38:39.165949+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:38:39.165949+0000","last_undegraded":"2024-09-10T11:38:39.165949+0000","last_fullsized":"2024-09-10T11:38:39.165949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137244+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:38:39.137244+0000","last_peered":"2024-09-10T11:38:39.137244+0000","last_clean":"2024-09-10T11:38:39.137244+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:38:39.137244+0000","last_undegraded":"2024-09-10T11:38:39.137244+0000","last_fullsized":"2024-09-10T11:38:39.137244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166432+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:38:39.166432+0000","last_peered":"2024-09-10T11:38:39.166432+0000","last_clean":"2024-09-10T11:38:39.166432+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:38:39.166432+0000","last_undegraded":"2024-09-10T11:38:39.166432+0000","last_fullsized":"2024-09-10T11:38:39.166432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638355+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:38:38.638355+0000","last_peered":"2024-09-10T11:38:38.638355+0000","last_clean":"2024-09-10T11:38:38.638355+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:38:38.638355+0000","last_undegraded":"2024-09-10T11:38:38.638355+0000","last_fullsized":"2024-09-10T11:38:38.638355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638239+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:38:38.638239+0000","last_peered":"2024-09-10T11:38:38.638239+0000","last_clean":"2024-09-10T11:38:38.638239+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:38:38.638239+0000","last_undegraded":"2024-09-10T11:38:38.638239+0000","last_fullsized":"2024-09-10T11:38:38.638239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637846+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:38:37.637846+0000","last_peered":"2024-09-10T11:38:37.637846+0000","last_clean":"2024-09-10T11:38:37.637846+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:38:37.637846+0000","last_undegraded":"2024-09-10T11:38:37.637846+0000","last_fullsized":"2024-09-10T11:38:37.637846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137648+0000","last_change":"2024-09-10T11:38:36.649867+0000","last_active":"2024-09-10T11:38:39.137648+0000","last_peered":"2024-09-10T11:38:39.137648+0000","last_clean":"2024-09-10T11:38:39.137648+0000","last_became_active":"2024-09-10T11:38:36.648237+0000","last_became_peered":"2024-09-10T11:38:36.648237+0000","last_unstale":"2024-09-10T11:38:39.137648+0000","last_undegraded":"2024-09-10T11:38:39.137648+0000","last_fullsized":"2024-09-10T11:38:39.137648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166145+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:38:39.166145+0000","last_peered":"2024-09-10T11:38:39.166145+0000","last_clean":"2024-09-10T11:38:39.166145+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:38:39.166145+0000","last_undegraded":"2024-09-10T11:38:39.166145+0000","last_fullsized":"2024-09-10T11:38:39.166145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634591+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:38:37.634591+0000","last_peered":"2024-09-10T11:38:37.634591+0000","last_clean":"2024-09-10T11:38:37.634591+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:38:37.634591+0000","last_undegraded":"2024-09-10T11:38:37.634591+0000","last_fullsized":"2024-09-10T11:38:37.634591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636309+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:38:37.636309+0000","last_peered":"2024-09-10T11:38:37.636309+0000","last_clean":"2024-09-10T11:38:37.636309+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:38:37.636309+0000","last_undegraded":"2024-09-10T11:38:37.636309+0000","last_fullsized":"2024-09-10T11:38:37.636309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637255+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:38:37.637255+0000","last_peered":"2024-09-10T11:38:37.637255+0000","last_clean":"2024-09-10T11:38:37.637255+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:38:37.637255+0000","last_undegraded":"2024-09-10T11:38:37.637255+0000","last_fullsized":"2024-09-10T11:38:37.637255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165966+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:38:39.165966+0000","last_peered":"2024-09-10T11:38:39.165966+0000","last_clean":"2024-09-10T11:38:39.165966+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:38:39.165966+0000","last_undegraded":"2024-09-10T11:38:39.165966+0000","last_fullsized":"2024-09-10T11:38:39.165966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166663+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:38:39.166663+0000","last_peered":"2024-09-10T11:38:39.166663+0000","last_clean":"2024-09-10T11:38:39.166663+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:38:39.166663+0000","last_undegraded":"2024-09-10T11:38:39.166663+0000","last_fullsized":"2024-09-10T11:38:39.166663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638287+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:38:38.638287+0000","last_peered":"2024-09-10T11:38:38.638287+0000","last_clean":"2024-09-10T11:38:38.638287+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:38:38.638287+0000","last_undegraded":"2024-09-10T11:38:38.638287+0000","last_fullsized":"2024-09-10T11:38:38.638287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166357+0000","last_change":"2024-09-10T11:38:36.643946+0000","last_active":"2024-09-10T11:38:39.166357+0000","last_peered":"2024-09-10T11:38:39.166357+0000","last_clean":"2024-09-10T11:38:39.166357+0000","last_became_active":"2024-09-10T11:38:36.643648+0000","last_became_peered":"2024-09-10T11:38:36.643648+0000","last_unstale":"2024-09-10T11:38:39.166357+0000","last_undegraded":"2024-09-10T11:38:39.166357+0000","last_fullsized":"2024-09-10T11:38:39.166357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637479+0000","last_change":"2024-09-10T11:38:36.643116+0000","last_active":"2024-09-10T11:38:37.637479+0000","last_peered":"2024-09-10T11:38:37.637479+0000","last_clean":"2024-09-10T11:38:37.637479+0000","last_became_active":"2024-09-10T11:38:36.642805+0000","last_became_peered":"2024-09-10T11:38:36.642805+0000","last_unstale":"2024-09-10T11:38:37.637479+0000","last_undegraded":"2024-09-10T11:38:37.637479+0000","last_fullsized":"2024-09-10T11:38:37.637479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:53.917503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137290+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:38:39.137290+0000","last_peered":"2024-09-10T11:38:39.137290+0000","last_clean":"2024-09-10T11:38:39.137290+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:38:39.137290+0000","last_undegraded":"2024-09-10T11:38:39.137290+0000","last_fullsized":"2024-09-10T11:38:39.137290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636477+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:38:37.636477+0000","last_peered":"2024-09-10T11:38:37.636477+0000","last_clean":"2024-09-10T11:38:37.636477+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:38:37.636477+0000","last_undegraded":"2024-09-10T11:38:37.636477+0000","last_fullsized":"2024-09-10T11:38:37.636477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137797+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:38:39.137797+0000","last_peered":"2024-09-10T11:38:39.137797+0000","last_clean":"2024-09-10T11:38:39.137797+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:38:39.137797+0000","last_undegraded":"2024-09-10T11:38:39.137797+0000","last_fullsized":"2024-09-10T11:38:39.137797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638350+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:38:38.638350+0000","last_peered":"2024-09-10T11:38:38.638350+0000","last_clean":"2024-09-10T11:38:38.638350+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:38:38.638350+0000","last_undegraded":"2024-09-10T11:38:38.638350+0000","last_fullsized":"2024-09-10T11:38:38.638350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634892+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:38:37.634892+0000","last_peered":"2024-09-10T11:38:37.634892+0000","last_clean":"2024-09-10T11:38:37.634892+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:38:37.634892+0000","last_undegraded":"2024-09-10T11:38:37.634892+0000","last_fullsized":"2024-09-10T11:38:37.634892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137925+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:38:39.137925+0000","last_peered":"2024-09-10T11:38:39.137925+0000","last_clean":"2024-09-10T11:38:39.137925+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:38:39.137925+0000","last_undegraded":"2024-09-10T11:38:39.137925+0000","last_fullsized":"2024-09-10T11:38:39.137925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166405+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:38:39.166405+0000","last_peered":"2024-09-10T11:38:39.166405+0000","last_clean":"2024-09-10T11:38:39.166405+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:38:39.166405+0000","last_undegraded":"2024-09-10T11:38:39.166405+0000","last_fullsized":"2024-09-10T11:38:39.166405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637858+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:38:37.637858+0000","last_peered":"2024-09-10T11:38:37.637858+0000","last_clean":"2024-09-10T11:38:37.637858+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:38:37.637858+0000","last_undegraded":"2024-09-10T11:38:37.637858+0000","last_fullsized":"2024-09-10T11:38:37.637858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165985+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:38:39.165985+0000","last_peered":"2024-09-10T11:38:39.165985+0000","last_clean":"2024-09-10T11:38:39.165985+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:38:39.165985+0000","last_undegraded":"2024-09-10T11:38:39.165985+0000","last_fullsized":"2024-09-10T11:38:39.165985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638232+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:38:38.638232+0000","last_peered":"2024-09-10T11:38:38.638232+0000","last_clean":"2024-09-10T11:38:38.638232+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:38:38.638232+0000","last_undegraded":"2024-09-10T11:38:38.638232+0000","last_fullsized":"2024-09-10T11:38:38.638232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636281+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:38:37.636281+0000","last_peered":"2024-09-10T11:38:37.636281+0000","last_clean":"2024-09-10T11:38:37.636281+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:38:37.636281+0000","last_undegraded":"2024-09-10T11:38:37.636281+0000","last_fullsized":"2024-09-10T11:38:37.636281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137814+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:38:39.137814+0000","last_peered":"2024-09-10T11:38:39.137814+0000","last_clean":"2024-09-10T11:38:39.137814+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:38:39.137814+0000","last_undegraded":"2024-09-10T11:38:39.137814+0000","last_fullsized":"2024-09-10T11:38:39.137814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166662+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:38:39.166662+0000","last_peered":"2024-09-10T11:38:39.166662+0000","last_clean":"2024-09-10T11:38:39.166662+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:38:39.166662+0000","last_undegraded":"2024-09-10T11:38:39.166662+0000","last_fullsized":"2024-09-10T11:38:39.166662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637823+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:38:38.637823+0000","last_peered":"2024-09-10T11:38:38.637823+0000","last_clean":"2024-09-10T11:38:38.637823+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:38:38.637823+0000","last_undegraded":"2024-09-10T11:38:38.637823+0000","last_fullsized":"2024-09-10T11:38:38.637823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137316+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:38:39.137316+0000","last_peered":"2024-09-10T11:38:39.137316+0000","last_clean":"2024-09-10T11:38:39.137316+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:38:39.137316+0000","last_undegraded":"2024-09-10T11:38:39.137316+0000","last_fullsized":"2024-09-10T11:38:39.137316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137319+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:38:39.137319+0000","last_peered":"2024-09-10T11:38:39.137319+0000","last_clean":"2024-09-10T11:38:39.137319+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:38:39.137319+0000","last_undegraded":"2024-09-10T11:38:39.137319+0000","last_fullsized":"2024-09-10T11:38:39.137319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636420+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:38:37.636420+0000","last_peered":"2024-09-10T11:38:37.636420+0000","last_clean":"2024-09-10T11:38:37.636420+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:38:37.636420+0000","last_undegraded":"2024-09-10T11:38:37.636420+0000","last_fullsized":"2024-09-10T11:38:37.636420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634585+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:38:37.634585+0000","last_peered":"2024-09-10T11:38:37.634585+0000","last_clean":"2024-09-10T11:38:37.634585+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:38:37.634585+0000","last_undegraded":"2024-09-10T11:38:37.634585+0000","last_fullsized":"2024-09-10T11:38:37.634585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638124+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:38:38.638124+0000","last_peered":"2024-09-10T11:38:38.638124+0000","last_clean":"2024-09-10T11:38:38.638124+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:38:38.638124+0000","last_undegraded":"2024-09-10T11:38:38.638124+0000","last_fullsized":"2024-09-10T11:38:38.638124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636901+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:38:37.636901+0000","last_peered":"2024-09-10T11:38:37.636901+0000","last_clean":"2024-09-10T11:38:37.636901+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:38:37.636901+0000","last_undegraded":"2024-09-10T11:38:37.636901+0000","last_fullsized":"2024-09-10T11:38:37.636901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636860+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:38:37.636860+0000","last_peered":"2024-09-10T11:38:37.636860+0000","last_clean":"2024-09-10T11:38:37.636860+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:38:37.636860+0000","last_undegraded":"2024-09-10T11:38:37.636860+0000","last_fullsized":"2024-09-10T11:38:37.636860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166003+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:38:39.166003+0000","last_peered":"2024-09-10T11:38:39.166003+0000","last_clean":"2024-09-10T11:38:39.166003+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:38:39.166003+0000","last_undegraded":"2024-09-10T11:38:39.166003+0000","last_fullsized":"2024-09-10T11:38:39.166003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634824+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:38:37.634824+0000","last_peered":"2024-09-10T11:38:37.634824+0000","last_clean":"2024-09-10T11:38:37.634824+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:38:37.634824+0000","last_undegraded":"2024-09-10T11:38:37.634824+0000","last_fullsized":"2024-09-10T11:38:37.634824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637941+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:38:37.637941+0000","last_peered":"2024-09-10T11:38:37.637941+0000","last_clean":"2024-09-10T11:38:37.637941+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:38:37.637941+0000","last_undegraded":"2024-09-10T11:38:37.637941+0000","last_fullsized":"2024-09-10T11:38:37.637941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637984+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:38:38.637984+0000","last_peered":"2024-09-10T11:38:38.637984+0000","last_clean":"2024-09-10T11:38:38.637984+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:38:38.637984+0000","last_undegraded":"2024-09-10T11:38:38.637984+0000","last_fullsized":"2024-09-10T11:38:38.637984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166328+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:38:39.166328+0000","last_peered":"2024-09-10T11:38:39.166328+0000","last_clean":"2024-09-10T11:38:39.166328+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:38:39.166328+0000","last_undegraded":"2024-09-10T11:38:39.166328+0000","last_fullsized":"2024-09-10T11:38:39.166328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166556+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:38:39.166556+0000","last_peered":"2024-09-10T11:38:39.166556+0000","last_clean":"2024-09-10T11:38:39.166556+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:38:39.166556+0000","last_undegraded":"2024-09-10T11:38:39.166556+0000","last_fullsized":"2024-09-10T11:38:39.166556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166356+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:38:39.166356+0000","last_peered":"2024-09-10T11:38:39.166356+0000","last_clean":"2024-09-10T11:38:39.166356+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:38:39.166356+0000","last_undegraded":"2024-09-10T11:38:39.166356+0000","last_fullsized":"2024-09-10T11:38:39.166356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637603+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:38:37.637603+0000","last_peered":"2024-09-10T11:38:37.637603+0000","last_clean":"2024-09-10T11:38:37.637603+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:38:37.637603+0000","last_undegraded":"2024-09-10T11:38:37.637603+0000","last_fullsized":"2024-09-10T11:38:37.637603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166332+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:38:39.166332+0000","last_peered":"2024-09-10T11:38:39.166332+0000","last_clean":"2024-09-10T11:38:39.166332+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:38:39.166332+0000","last_undegraded":"2024-09-10T11:38:39.166332+0000","last_fullsized":"2024-09-10T11:38:39.166332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637806+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:38:38.637806+0000","last_peered":"2024-09-10T11:38:38.637806+0000","last_clean":"2024-09-10T11:38:38.637806+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:38:38.637806+0000","last_undegraded":"2024-09-10T11:38:38.637806+0000","last_fullsized":"2024-09-10T11:38:38.637806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638020+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:38:38.638020+0000","last_peered":"2024-09-10T11:38:38.638020+0000","last_clean":"2024-09-10T11:38:38.638020+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:38:38.638020+0000","last_undegraded":"2024-09-10T11:38:38.638020+0000","last_fullsized":"2024-09-10T11:38:38.638020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165609+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:38:39.165609+0000","last_peered":"2024-09-10T11:38:39.165609+0000","last_clean":"2024-09-10T11:38:39.165609+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:38:39.165609+0000","last_undegraded":"2024-09-10T11:38:39.165609+0000","last_fullsized":"2024-09-10T11:38:39.165609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166134+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:38:39.166134+0000","last_peered":"2024-09-10T11:38:39.166134+0000","last_clean":"2024-09-10T11:38:39.166134+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:38:39.166134+0000","last_undegraded":"2024-09-10T11:38:39.166134+0000","last_fullsized":"2024-09-10T11:38:39.166134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637534+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:38:37.637534+0000","last_peered":"2024-09-10T11:38:37.637534+0000","last_clean":"2024-09-10T11:38:37.637534+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:38:37.637534+0000","last_undegraded":"2024-09-10T11:38:37.637534+0000","last_fullsized":"2024-09-10T11:38:37.637534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166467+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:38:39.166467+0000","last_peered":"2024-09-10T11:38:39.166467+0000","last_clean":"2024-09-10T11:38:39.166467+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:38:39.166467+0000","last_undegraded":"2024-09-10T11:38:39.166467+0000","last_fullsized":"2024-09-10T11:38:39.166467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166064+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:38:39.166064+0000","last_peered":"2024-09-10T11:38:39.166064+0000","last_clean":"2024-09-10T11:38:39.166064+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:38:39.166064+0000","last_undegraded":"2024-09-10T11:38:39.166064+0000","last_fullsized":"2024-09-10T11:38:39.166064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166661+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:38:39.166661+0000","last_peered":"2024-09-10T11:38:39.166661+0000","last_clean":"2024-09-10T11:38:39.166661+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:38:39.166661+0000","last_undegraded":"2024-09-10T11:38:39.166661+0000","last_fullsized":"2024-09-10T11:38:39.166661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634985+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:38:37.634985+0000","last_peered":"2024-09-10T11:38:37.634985+0000","last_clean":"2024-09-10T11:38:37.634985+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:38:37.634985+0000","last_undegraded":"2024-09-10T11:38:37.634985+0000","last_fullsized":"2024-09-10T11:38:37.634985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636810+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:38:37.636810+0000","last_peered":"2024-09-10T11:38:37.636810+0000","last_clean":"2024-09-10T11:38:37.636810+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:38:37.636810+0000","last_undegraded":"2024-09-10T11:38:37.636810+0000","last_fullsized":"2024-09-10T11:38:37.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165675+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:38:39.165675+0000","last_peered":"2024-09-10T11:38:39.165675+0000","last_clean":"2024-09-10T11:38:39.165675+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:38:39.165675+0000","last_undegraded":"2024-09-10T11:38:39.165675+0000","last_fullsized":"2024-09-10T11:38:39.165675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166382+0000","last_change":"2024-09-10T11:38:36.653163+0000","last_active":"2024-09-10T11:38:39.166382+0000","last_peered":"2024-09-10T11:38:39.166382+0000","last_clean":"2024-09-10T11:38:39.166382+0000","last_became_active":"2024-09-10T11:38:36.652861+0000","last_became_peered":"2024-09-10T11:38:36.652861+0000","last_unstale":"2024-09-10T11:38:39.166382+0000","last_undegraded":"2024-09-10T11:38:39.166382+0000","last_fullsized":"2024-09-10T11:38:39.166382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165892+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:39.165892+0000","last_peered":"2024-09-10T11:38:39.165892+0000","last_clean":"2024-09-10T11:38:39.165892+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:39.165892+0000","last_undegraded":"2024-09-10T11:38:39.165892+0000","last_fullsized":"2024-09-10T11:38:39.165892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636247+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:38:37.636247+0000","last_peered":"2024-09-10T11:38:37.636247+0000","last_clean":"2024-09-10T11:38:37.636247+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:38:37.636247+0000","last_undegraded":"2024-09-10T11:38:37.636247+0000","last_fullsized":"2024-09-10T11:38:37.636247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137684+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:38:39.137684+0000","last_peered":"2024-09-10T11:38:39.137684+0000","last_clean":"2024-09-10T11:38:39.137684+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:38:39.137684+0000","last_undegraded":"2024-09-10T11:38:39.137684+0000","last_fullsized":"2024-09-10T11:38:39.137684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166230+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:38:39.166230+0000","last_peered":"2024-09-10T11:38:39.166230+0000","last_clean":"2024-09-10T11:38:39.166230+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:38:39.166230+0000","last_undegraded":"2024-09-10T11:38:39.166230+0000","last_fullsized":"2024-09-10T11:38:39.166230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165865+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:38:39.165865+0000","last_peered":"2024-09-10T11:38:39.165865+0000","last_clean":"2024-09-10T11:38:39.165865+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:38:39.165865+0000","last_undegraded":"2024-09-10T11:38:39.165865+0000","last_fullsized":"2024-09-10T11:38:39.165865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166086+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:38:39.166086+0000","last_peered":"2024-09-10T11:38:39.166086+0000","last_clean":"2024-09-10T11:38:39.166086+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:38:39.166086+0000","last_undegraded":"2024-09-10T11:38:39.166086+0000","last_fullsized":"2024-09-10T11:38:39.166086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634619+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:38:37.634619+0000","last_peered":"2024-09-10T11:38:37.634619+0000","last_clean":"2024-09-10T11:38:37.634619+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:38:37.634619+0000","last_undegraded":"2024-09-10T11:38:37.634619+0000","last_fullsized":"2024-09-10T11:38:37.634619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637700+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:38:37.637700+0000","last_peered":"2024-09-10T11:38:37.637700+0000","last_clean":"2024-09-10T11:38:37.637700+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:38:37.637700+0000","last_undegraded":"2024-09-10T11:38:37.637700+0000","last_fullsized":"2024-09-10T11:38:37.637700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637363+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:38:37.637363+0000","last_peered":"2024-09-10T11:38:37.637363+0000","last_clean":"2024-09-10T11:38:37.637363+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:38:37.637363+0000","last_undegraded":"2024-09-10T11:38:37.637363+0000","last_fullsized":"2024-09-10T11:38:37.637363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634761+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:38:37.634761+0000","last_peered":"2024-09-10T11:38:37.634761+0000","last_clean":"2024-09-10T11:38:37.634761+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:38:37.634761+0000","last_undegraded":"2024-09-10T11:38:37.634761+0000","last_fullsized":"2024-09-10T11:38:37.634761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636997+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:38:37.636997+0000","last_peered":"2024-09-10T11:38:37.636997+0000","last_clean":"2024-09-10T11:38:37.636997+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:38:37.636997+0000","last_undegraded":"2024-09-10T11:38:37.636997+0000","last_fullsized":"2024-09-10T11:38:37.636997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166586+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:38:39.166586+0000","last_peered":"2024-09-10T11:38:39.166586+0000","last_clean":"2024-09-10T11:38:39.166586+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:38:39.166586+0000","last_undegraded":"2024-09-10T11:38:39.166586+0000","last_fullsized":"2024-09-10T11:38:39.166586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634718+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:38:37.634718+0000","last_peered":"2024-09-10T11:38:37.634718+0000","last_clean":"2024-09-10T11:38:37.634718+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:38:37.634718+0000","last_undegraded":"2024-09-10T11:38:37.634718+0000","last_fullsized":"2024-09-10T11:38:37.634718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637077+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:38:38.637077+0000","last_peered":"2024-09-10T11:38:38.637077+0000","last_clean":"2024-09-10T11:38:38.637077+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:38:38.637077+0000","last_undegraded":"2024-09-10T11:38:38.637077+0000","last_fullsized":"2024-09-10T11:38:38.637077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137549+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:38:39.137549+0000","last_peered":"2024-09-10T11:38:39.137549+0000","last_clean":"2024-09-10T11:38:39.137549+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:38:39.137549+0000","last_undegraded":"2024-09-10T11:38:39.137549+0000","last_fullsized":"2024-09-10T11:38:39.137549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638190+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:38:38.638190+0000","last_peered":"2024-09-10T11:38:38.638190+0000","last_clean":"2024-09-10T11:38:38.638190+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:38:38.638190+0000","last_undegraded":"2024-09-10T11:38:38.638190+0000","last_fullsized":"2024-09-10T11:38:38.638190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166762+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:38:39.166762+0000","last_peered":"2024-09-10T11:38:39.166762+0000","last_clean":"2024-09-10T11:38:39.166762+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:38:39.166762+0000","last_undegraded":"2024-09-10T11:38:39.166762+0000","last_fullsized":"2024-09-10T11:38:39.166762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165790+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:38:39.165790+0000","last_peered":"2024-09-10T11:38:39.165790+0000","last_clean":"2024-09-10T11:38:39.165790+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:38:39.165790+0000","last_undegraded":"2024-09-10T11:38:39.165790+0000","last_fullsized":"2024-09-10T11:38:39.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636602+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:38:37.636602+0000","last_peered":"2024-09-10T11:38:37.636602+0000","last_clean":"2024-09-10T11:38:37.636602+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:38:37.636602+0000","last_undegraded":"2024-09-10T11:38:37.636602+0000","last_fullsized":"2024-09-10T11:38:37.636602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634705+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:38:37.634705+0000","last_peered":"2024-09-10T11:38:37.634705+0000","last_clean":"2024-09-10T11:38:37.634705+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:38:37.634705+0000","last_undegraded":"2024-09-10T11:38:37.634705+0000","last_fullsized":"2024-09-10T11:38:37.634705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137451+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:38:39.137451+0000","last_peered":"2024-09-10T11:38:39.137451+0000","last_clean":"2024-09-10T11:38:39.137451+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:38:39.137451+0000","last_undegraded":"2024-09-10T11:38:39.137451+0000","last_fullsized":"2024-09-10T11:38:39.137451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634609+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:38:37.634609+0000","last_peered":"2024-09-10T11:38:37.634609+0000","last_clean":"2024-09-10T11:38:37.634609+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:38:37.634609+0000","last_undegraded":"2024-09-10T11:38:37.634609+0000","last_fullsized":"2024-09-10T11:38:37.634609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137860+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:38:39.137860+0000","last_peered":"2024-09-10T11:38:39.137860+0000","last_clean":"2024-09-10T11:38:39.137860+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:38:39.137860+0000","last_undegraded":"2024-09-10T11:38:39.137860+0000","last_fullsized":"2024-09-10T11:38:39.137860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166497+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:38:39.166497+0000","last_peered":"2024-09-10T11:38:39.166497+0000","last_clean":"2024-09-10T11:38:39.166497+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:38:39.166497+0000","last_undegraded":"2024-09-10T11:38:39.166497+0000","last_fullsized":"2024-09-10T11:38:39.166497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638081+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:38:38.638081+0000","last_peered":"2024-09-10T11:38:38.638081+0000","last_clean":"2024-09-10T11:38:38.638081+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:38:38.638081+0000","last_undegraded":"2024-09-10T11:38:38.638081+0000","last_fullsized":"2024-09-10T11:38:38.638081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637039+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:38:37.637039+0000","last_peered":"2024-09-10T11:38:37.637039+0000","last_clean":"2024-09-10T11:38:37.637039+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:38:37.637039+0000","last_undegraded":"2024-09-10T11:38:37.637039+0000","last_fullsized":"2024-09-10T11:38:37.637039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166074+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:38:39.166074+0000","last_peered":"2024-09-10T11:38:39.166074+0000","last_clean":"2024-09-10T11:38:39.166074+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:38:39.166074+0000","last_undegraded":"2024-09-10T11:38:39.166074+0000","last_fullsized":"2024-09-10T11:38:39.166074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636640+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:38:37.636640+0000","last_peered":"2024-09-10T11:38:37.636640+0000","last_clean":"2024-09-10T11:38:37.636640+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:38:37.636640+0000","last_undegraded":"2024-09-10T11:38:37.636640+0000","last_fullsized":"2024-09-10T11:38:37.636640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166462+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:38:39.166462+0000","last_peered":"2024-09-10T11:38:39.166462+0000","last_clean":"2024-09-10T11:38:39.166462+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:38:39.166462+0000","last_undegraded":"2024-09-10T11:38:39.166462+0000","last_fullsized":"2024-09-10T11:38:39.166462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165811+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:38:39.165811+0000","last_peered":"2024-09-10T11:38:39.165811+0000","last_clean":"2024-09-10T11:38:39.165811+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:38:39.165811+0000","last_undegraded":"2024-09-10T11:38:39.165811+0000","last_fullsized":"2024-09-10T11:38:39.165811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137626+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:38:39.137626+0000","last_peered":"2024-09-10T11:38:39.137626+0000","last_clean":"2024-09-10T11:38:39.137626+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:38:39.137626+0000","last_undegraded":"2024-09-10T11:38:39.137626+0000","last_fullsized":"2024-09-10T11:38:39.137626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.138032+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:38:39.138032+0000","last_peered":"2024-09-10T11:38:39.138032+0000","last_clean":"2024-09-10T11:38:39.138032+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:38:39.138032+0000","last_undegraded":"2024-09-10T11:38:39.138032+0000","last_fullsized":"2024-09-10T11:38:39.138032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166800+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:38:39.166800+0000","last_peered":"2024-09-10T11:38:39.166800+0000","last_clean":"2024-09-10T11:38:39.166800+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:38:39.166800+0000","last_undegraded":"2024-09-10T11:38:39.166800+0000","last_fullsized":"2024-09-10T11:38:39.166800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:44.205 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T11:38:44.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T11:38:44.206 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T11:38:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 -- 172.21.15.57:0/1331648633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 msgr2=0x7f7be40d4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1331648633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be40d4820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8005fd0 tx=0x7f7bd802a5d0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 -- 172.21.15.57:0/1331648633 shutdown_connections 2024-09-10T11:38:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1331648633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be40d4820 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1331648633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7be41612a0 0x7f7be40d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 -- 172.21.15.57:0/1331648633 >> 172.21.15.57:0/1331648633 conn(0x7f7be409cfe0 msgr2=0x7f7be40d3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 -- 172.21.15.57:0/1331648633 shutdown_connections 2024-09-10T11:38:44.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.346+0000 7f7bea51e640 1 -- 172.21.15.57:0/1331648633 wait complete. 2024-09-10T11:38:44.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.347+0000 7f7bea51e640 1 Processor -- start 2024-09-10T11:38:44.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.347+0000 7f7bea51e640 1 -- start start 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7bea51e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be41f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7bea51e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be40ce840 0x7f7be40cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7bea51e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7be41612a0 0x7f7be4151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7bea51e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40b3690 con 0x7f7be40b49a0 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7bea51e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40b3510 con 0x7f7be40ce840 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7bea51e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7be40b3810 con 0x7f7be41612a0 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be41f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be41f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46538/0 (socket says 172.21.15.57:46538) 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7be3fff640 1 -- 172.21.15.57:0/1739603597 learned_addr learned my addr 172.21.15.57:0/1739603597 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7be8abb640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7be41612a0 0x7f7be4151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.348+0000 7f7be37fe640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be40ce840 0x7f7be40cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be3fff640 1 -- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7be41612a0 msgr2=0x7f7be4151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be3fff640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7be41612a0 0x7f7be4151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be3fff640 1 -- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be40ce840 msgr2=0x7f7be40cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be3fff640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be40ce840 0x7f7be40cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be3fff640 1 -- 172.21.15.57:0/1739603597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40cafa0 con 0x7f7be40b49a0 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be37fe640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be40ce840 0x7f7be40cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be3fff640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be41f8d00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400d740 tx=0x7f7bd400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4017070 con 0x7f7be40b49a0 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd4009d20 con 0x7f7be40b49a0 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be41f8280 con 0x7f7be40b49a0 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40106c0 con 0x7f7be40b49a0 2024-09-10T11:38:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.349+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be40cc7c0 con 0x7f7be40b49a0 2024-09-10T11:38:44.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.350+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be40d1900 con 0x7f7be40b49a0 2024-09-10T11:38:44.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.351+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f7bd401a070 con 0x7f7be40b49a0 2024-09-10T11:38:44.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.351+0000 7f7be0ff9640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bd00750a0 0x7f7bd0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.351+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd40964b0 con 0x7f7be40b49a0 2024-09-10T11:38:44.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.352+0000 7f7be37fe640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bd00750a0 0x7f7bd0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.352+0000 7f7be37fe640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bd00750a0 0x7f7bd0077560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8033000 tx=0x7f7bd8004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.355+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f7be41f8280 con 0x7f7be40b49a0 2024-09-10T11:38:44.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.515+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7be40b30c0 con 0x7f7be40b49a0 2024-09-10T11:38:44.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.516+0000 7f7be0ff9640 1 -- 172.21.15.57:0/1739603597 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f7bd40601d0 con 0x7f7be40b49a0 2024-09-10T11:38:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.517+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bd00750a0 msgr2=0x7f7bd0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.517+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bd00750a0 0x7f7bd0077560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8033000 tx=0x7f7bd8004730 comp rx=0 tx=0).stop 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.517+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 msgr2=0x7f7be41f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.517+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be41f8d00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400d740 tx=0x7f7bd400dc00 comp rx=0 tx=0).stop 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 shutdown_connections 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7bd00750a0 0x7f7bd0077560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7be41612a0 0x7f7be4151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be40ce840 0x7f7be40cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 --2- 172.21.15.57:0/1739603597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be40b49a0 0x7f7be41f8d00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 >> 172.21.15.57:0/1739603597 conn(0x7f7be409cfe0 msgr2=0x7f7be406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 shutdown_connections 2024-09-10T11:38:44.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.518+0000 7f7bea51e640 1 -- 172.21.15.57:0/1739603597 wait complete. 2024-09-10T11:38:44.529 INFO:teuthology.orchestra.run.smithi057.stdout:[{"version":27,"timestamp":"2024-09-10T11:38:23.729787+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"5396.927426"}]}] 2024-09-10T11:38:44.529 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T11:38:44.529 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T11:38:44.529 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T11:38:44.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T11:38:44.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 -- 172.21.15.57:0/2938241012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815bdf0 msgr2=0x7efd780d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/2938241012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815bdf0 0x7efd780d1e20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd780cf6f0 tx=0x7efd7002aa30 comp rx=0 tx=0).stop 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 -- 172.21.15.57:0/2938241012 shutdown_connections 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/2938241012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815bdf0 0x7efd780d1e20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/2938241012 >> v2:172.21.15.154:3300/0 conn(0x7efd780b3280 0x7efd780d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/2938241012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7815ba10 0x7efd780b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 -- 172.21.15.57:0/2938241012 >> 172.21.15.57:0/2938241012 conn(0x7efd7809aa20 msgr2=0x7efd7809ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 -- 172.21.15.57:0/2938241012 shutdown_connections 2024-09-10T11:38:44.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.635+0000 7efd7e8c8640 1 -- 172.21.15.57:0/2938241012 wait complete. 2024-09-10T11:38:44.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.636+0000 7efd7e8c8640 1 Processor -- start 2024-09-10T11:38:44.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.636+0000 7efd7e8c8640 1 -- start start 2024-09-10T11:38:44.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7e8c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd780b3280 0x7efd780b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7e8c8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 0x7efd780c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7e8c8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7815bdf0 0x7efd780ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7e8c8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efd780b1720 con 0x7efd7815ba10 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7e8c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd780b15a0 con 0x7efd780b3280 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7e8c8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efd780b18a0 con 0x7efd7815bdf0 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd777fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 0x7efd780c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd777fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 0x7efd780c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46564/0 (socket says 172.21.15.57:46564) 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd777fe640 1 -- 172.21.15.57:0/904454622 learned_addr learned my addr 172.21.15.57:0/904454622 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd77fff640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd780b3280 0x7efd780b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.637+0000 7efd7ce65640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7815bdf0 0x7efd780ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd777fe640 1 -- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7815bdf0 msgr2=0x7efd780ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd777fe640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7815bdf0 0x7efd780ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd777fe640 1 -- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd780b3280 msgr2=0x7efd780b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd777fe640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd780b3280 0x7efd780b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd777fe640 1 -- 172.21.15.57:0/904454622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd780c67a0 con 0x7efd7815ba10 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd777fe640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 0x7efd780c6260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6000d950 tx=0x7efd6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60017070 con 0x7efd7815ba10 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd60009d20 con 0x7efd7815ba10 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd780c8180 con 0x7efd7815ba10 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60004280 con 0x7efd7815ba10 2024-09-10T11:38:44.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.638+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7806da80 con 0x7efd7815ba10 2024-09-10T11:38:44.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.639+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd780b1dc0 con 0x7efd7815ba10 2024-09-10T11:38:44.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.640+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7efd600035f0 con 0x7efd7815ba10 2024-09-10T11:38:44.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.640+0000 7efd74ff9640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7efd580750a0 0x7efd58077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.641+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd600965c0 con 0x7efd7815ba10 2024-09-10T11:38:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.641+0000 7efd77fff640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7efd580750a0 0x7efd58077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.641+0000 7efd77fff640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7efd580750a0 0x7efd58077560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd68005fd0 tx=0x7efd6800b390 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.644+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7efd60020030 con 0x7efd7815ba10 2024-09-10T11:38:44.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.854+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7efd780c5420 con 0x7efd7815ba10 2024-09-10T11:38:44.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.857+0000 7efd74ff9640 1 -- 172.21.15.57:0/904454622 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+188468 (secure 0 0 0) 0x7efd780c67a0 con 0x7efd7815ba10 2024-09-10T11:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.859+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7efd580750a0 msgr2=0x7efd58077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.859+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7efd580750a0 0x7efd58077560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd68005fd0 tx=0x7efd6800b390 comp rx=0 tx=0).stop 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.859+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 msgr2=0x7efd780c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 0x7efd780c6260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6000d950 tx=0x7efd6000de10 comp rx=0 tx=0).stop 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 shutdown_connections 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7efd580750a0 0x7efd58077560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7815bdf0 0x7efd780ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd7815ba10 0x7efd780c6260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 --2- 172.21.15.57:0/904454622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd780b3280 0x7efd780b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 >> 172.21.15.57:0/904454622 conn(0x7efd7809aa20 msgr2=0x7efd78071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 shutdown_connections 2024-09-10T11:38:44.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.860+0000 7efd7e8c8640 1 -- 172.21.15.57:0/904454622 wait complete. 2024-09-10T11:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"flags":0,"active_gid":4133,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2487136894},{"type":"v1","addr":"172.21.15.154:6817","nonce":2487136894}]},"active_addr":"172.21.15.154:6817/2487136894","active_change":"2024-09-10T11:38:16.180573+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4150,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":false,"error_string":"No module named 'ceph.fs'","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":false,"error_string":"No module named 'ceph.fs'","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":4069058105}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":137652827}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3611909159}]}]} 2024-09-10T11:38:44.875 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T11:38:44.875 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T11:38:44.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:44.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381bb7c640 1 -- 172.21.15.57:0/3660718168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 msgr2=0x7f3800004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381bb7c640 1 --2- 172.21.15.57:0/3660718168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f3800004c80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3804001650 tx=0x7f3800005830 comp rx=0 tx=0).stop 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381a119640 1 -- 172.21.15.57:0/3660718168 reap_dead start 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381bb7c640 1 -- 172.21.15.57:0/3660718168 shutdown_connections 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381bb7c640 1 -- 172.21.15.57:0/3660718168 >> 172.21.15.57:0/3660718168 conn(0x7f381408d6d0 msgr2=0x7f381409cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381bb7c640 1 -- 172.21.15.57:0/3660718168 shutdown_connections 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.979+0000 7f381bb7c640 1 -- 172.21.15.57:0/3660718168 wait complete. 2024-09-10T11:38:44.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.980+0000 7f381bb7c640 1 Processor -- start 2024-09-10T11:38:44.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.980+0000 7f381bb7c640 1 -- start start 2024-09-10T11:38:44.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381bb7c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f381415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381bb7c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3814151da0 0x7f38141559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381bb7c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38141f4b10 0x7f38140b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381bb7c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3814166cd0 con 0x7f3800004800 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381bb7c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3814166b50 con 0x7f3814151da0 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381bb7c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3814166e50 con 0x7f38141f4b10 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f3819918640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f381415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f3819918640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f381415bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46574/0 (socket says 172.21.15.57:46574) 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f3819918640 1 -- 172.21.15.57:0/993795179 learned_addr learned my addr 172.21.15.57:0/993795179 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.981+0000 7f381a119640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38141f4b10 0x7f38140b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819117640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3814151da0 0x7f38141559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819918640 1 -- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38141f4b10 msgr2=0x7f38140b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819918640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38141f4b10 0x7f38140b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819918640 1 -- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3814151da0 msgr2=0x7f38141559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819918640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3814151da0 0x7f38141559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819918640 1 -- 172.21.15.57:0/993795179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38141f5c50 con 0x7f3800004800 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819117640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3814151da0 0x7f38141559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f381a119640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38141f4b10 0x7f38140b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f3819918640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f381415bf60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f381000e660 tx=0x7f381000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810015030 con 0x7f3800004800 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3810004130 con 0x7f3800004800 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381000c840 con 0x7f3800004800 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38141f53b0 con 0x7f3800004800 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.982+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141f5970 con 0x7f3800004800 2024-09-10T11:38:44.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.983+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38140d3a20 con 0x7f3800004800 2024-09-10T11:38:44.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.984+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f3810018070 con 0x7f3800004800 2024-09-10T11:38:44.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.984+0000 7f380a7fc640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f37f80750d0 0x7f37f8077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:44.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.984+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3810096580 con 0x7f3800004800 2024-09-10T11:38:44.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.984+0000 7f3819117640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f37f80750d0 0x7f37f8077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:44.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.985+0000 7f3819117640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f37f80750d0 0x7f37f8077590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3804032000 tx=0x7f3804001190 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:44.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:44.988+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f38100608e0 con 0x7f3800004800 2024-09-10T11:38:45.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.150+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38140b9cf0 con 0x7f3800004800 2024-09-10T11:38:45.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.151+0000 7f380a7fc640 1 -- 172.21.15.57:0/993795179 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f38100601e0 con 0x7f3800004800 2024-09-10T11:38:45.152 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:45.152 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:37.629806+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:38:33.708684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:38:34.920262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f37f80750d0 msgr2=0x7f37f8077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f37f80750d0 0x7f37f8077590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3804032000 tx=0x7f3804001190 comp rx=0 tx=0).stop 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 msgr2=0x7f381415bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f381415bf60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f381000e660 tx=0x7f381000eb20 comp rx=0 tx=0).stop 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 shutdown_connections 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f37f80750d0 0x7f37f8077590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38141f4b10 0x7f38140b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3814151da0 0x7f38141559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 --2- 172.21.15.57:0/993795179 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3800004800 0x7f381415bf60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 >> 172.21.15.57:0/993795179 conn(0x7f381408d6d0 msgr2=0x7f38140cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 shutdown_connections 2024-09-10T11:38:45.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.153+0000 7f381bb7c640 1 -- 172.21.15.57:0/993795179 wait complete. 2024-09-10T11:38:45.164 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T11:38:45.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:38:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 -- 172.21.15.57:0/3968723003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 msgr2=0x7fdd880d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 --2- 172.21.15.57:0/3968723003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd880d29e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd880695f0 tx=0x7fdd8002a940 comp rx=0 tx=0).stop 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 -- 172.21.15.57:0/3968723003 shutdown_connections 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 --2- 172.21.15.57:0/3968723003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd880d29e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 --2- 172.21.15.57:0/3968723003 >> v2:172.21.15.154:3300/0 conn(0x7fdd8815dc60 0x7fdd880d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 -- 172.21.15.57:0/3968723003 >> 172.21.15.57:0/3968723003 conn(0x7fdd8809cf80 msgr2=0x7fdd880d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 -- 172.21.15.57:0/3968723003 shutdown_connections 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.268+0000 7fdd8e423640 1 -- 172.21.15.57:0/3968723003 wait complete. 2024-09-10T11:38:45.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.270+0000 7fdd8e423640 1 Processor -- start 2024-09-10T11:38:45.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.270+0000 7fdd8e423640 1 -- start start 2024-09-10T11:38:45.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd880d45b0 0x7fdd880c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8815dc60 0x7fdd88154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd881f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880d1e40 con 0x7fdd8815e040 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880d1cc0 con 0x7fdd8815dc60 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdd880d1fc0 con 0x7fdd880d45b0 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd881f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd881f4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46596/0 (socket says 172.21.15.57:46596) 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 -- 172.21.15.57:0/2780926189 learned_addr learned my addr 172.21.15.57:0/2780926189 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd87fff640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd880d45b0 0x7fdd880c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd877fe640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8815dc60 0x7fdd88154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 -- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd880d45b0 msgr2=0x7fdd880c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd880d45b0 0x7fdd880c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 -- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8815dc60 msgr2=0x7fdd88154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8815dc60 0x7fdd88154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 -- 172.21.15.57:0/2780926189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd880c7b70 con 0x7fdd8815e040 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd87fff640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd880d45b0 0x7fdd880c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8c9c0640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd881f4f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdd80005fd0 tx=0x7fdd80031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8003e070 con 0x7fdd8815e040 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd80004540 con 0x7fdd8815e040 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd880c7e50 con 0x7fdd8815e040 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80030430 con 0x7fdd8815e040 2024-09-10T11:38:45.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.271+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd880c8410 con 0x7fdd8815e040 2024-09-10T11:38:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.272+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd88162490 con 0x7fdd8815e040 2024-09-10T11:38:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.273+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fdd8003a440 con 0x7fdd8815e040 2024-09-10T11:38:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.273+0000 7fdd84ff9640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdd740750a0 0x7fdd74077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.274+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdd800b7d30 con 0x7fdd8815e040 2024-09-10T11:38:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.274+0000 7fdd87fff640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdd740750a0 0x7fdd74077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.274+0000 7fdd87fff640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdd740750a0 0x7fdd74077560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009c20 tx=0x7fdd78005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.277+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fdd800bc070 con 0x7fdd8815e040 2024-09-10T11:38:45.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.436+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd8815a4a0 con 0x7fdd8815e040 2024-09-10T11:38:45.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.437+0000 7fdd84ff9640 1 -- 172.21.15.57:0/2780926189 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fdd80082090 con 0x7fdd8815e040 2024-09-10T11:38:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:45.439 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:38:37.629806+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:38:33.708684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:38:34.920262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:38:45.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdd740750a0 msgr2=0x7fdd74077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdd740750a0 0x7fdd74077560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009c20 tx=0x7fdd78005f90 comp rx=0 tx=0).stop 2024-09-10T11:38:45.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 msgr2=0x7fdd881f4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd881f4f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdd80005fd0 tx=0x7fdd80031ea0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 shutdown_connections 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdd740750a0 0x7fdd74077560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd8815e040 0x7fdd881f4f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8815dc60 0x7fdd88154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 --2- 172.21.15.57:0/2780926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd880d45b0 0x7fdd880c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 >> 172.21.15.57:0/2780926189 conn(0x7fdd8809cf80 msgr2=0x7fdd8815a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 shutdown_connections 2024-09-10T11:38:45.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.439+0000 7fdd8e423640 1 -- 172.21.15.57:0/2780926189 wait complete. 2024-09-10T11:38:45.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T11:38:45.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T11:38:45.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T11:38:45.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T11:38:45.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T11:38:45.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T11:38:45.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T11:38:45.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.636+0000 7fc14bfff640 1 -- 172.21.15.57:0/2084612649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c0cfd40 msgr2=0x7fc14c0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.636+0000 7fc14bfff640 1 --2- 172.21.15.57:0/2084612649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c0cfd40 0x7fc14c0730a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009830 tx=0x7fc13c02a530 comp rx=0 tx=0).stop 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.636+0000 7fc14bfff640 1 -- 172.21.15.57:0/2084612649 shutdown_connections 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.636+0000 7fc14bfff640 1 --2- 172.21.15.57:0/2084612649 >> v2:172.21.15.154:3300/0 conn(0x7fc14c0d0120 0x7fc14c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.636+0000 7fc14bfff640 1 --2- 172.21.15.57:0/2084612649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c0cfd40 0x7fc14c0730a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.636+0000 7fc14bfff640 1 -- 172.21.15.57:0/2084612649 >> 172.21.15.57:0/2084612649 conn(0x7fc14c0b25b0 msgr2=0x7fc14c0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7f6522672640 1 -- 172.21.15.57:0/435111149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6514008770 msgr2=0x7f6514008c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7f6522672640 1 --2- 172.21.15.57:0/435111149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6514008770 0x7f6514008c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6518005fd0 tx=0x7f651802a510 comp rx=0 tx=0).stop 2024-09-10T11:38:45.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd605ffb640 1 -- 172.21.15.57:0/1478519680 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0317f0 con 0x7fd600034b90 2024-09-10T11:38:45.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fb5b30a9640 1 -- 172.21.15.57:0/30211190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 msgr2=0x7fb5ac06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fb5b30a9640 1 --2- 172.21.15.57:0/30211190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac06c8d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ce390 tx=0x7fb5a002a4d0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd607fff640 1 -- 172.21.15.57:0/1478519680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600034b90 msgr2=0x7fd60004fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd607fff640 1 --2- 172.21.15.57:0/1478519680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600034b90 0x7fd60004fcf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009830 tx=0x7fd5fc02a540 comp rx=0 tx=0).stop 2024-09-10T11:38:45.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd607fff640 1 -- 172.21.15.57:0/1478519680 shutdown_connections 2024-09-10T11:38:45.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fb5b30a9640 1 -- 172.21.15.57:0/30211190 shutdown_connections 2024-09-10T11:38:45.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fb5b30a9640 1 --2- 172.21.15.57:0/30211190 >> v2:172.21.15.57:3300/0 conn(0x7fb5ac0cdb40 0x7fb5ac0cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fb5b30a9640 1 --2- 172.21.15.57:0/30211190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac06c8d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fb5b30a9640 1 -- 172.21.15.57:0/30211190 >> 172.21.15.57:0/30211190 conn(0x7fb5ac0b24d0 msgr2=0x7fb5ac0b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 -- 172.21.15.57:0/224581660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f80cc1d0 msgr2=0x7fd8f80d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 --2- 172.21.15.57:0/224581660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f80cc1d0 0x7fd8f80d1b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009860 tx=0x7fd8ec02a4f0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 -- 172.21.15.57:0/224581660 shutdown_connections 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 --2- 172.21.15.57:0/224581660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f80cc1d0 0x7fd8f80d1b10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 -- 172.21.15.57:0/224581660 >> 172.21.15.57:0/224581660 conn(0x7fd8f809aa20 msgr2=0x7fd8f809ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 -- 172.21.15.57:0/224581660 shutdown_connections 2024-09-10T11:38:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd8fe532640 1 -- 172.21.15.57:0/224581660 wait complete. 2024-09-10T11:38:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fb5b30a9640 1 -- 172.21.15.57:0/30211190 shutdown_connections 2024-09-10T11:38:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f0ec1c73640 1 -- 172.21.15.57:0/1353924746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc162110 msgr2=0x7f0ebc068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f0ec1c73640 1 --2- 172.21.15.57:0/1353924746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc162110 0x7f0ebc068610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb002a4a0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fd607fff640 1 --2- 172.21.15.57:0/1478519680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600034b90 0x7fd60004fcf0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009830 tx=0x7fd5fc02a540 comp rx=0 tx=0).stop 2024-09-10T11:38:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fd607fff640 1 -- 172.21.15.57:0/1478519680 >> 172.21.15.57:0/1478519680 conn(0x7fd60001e880 msgr2=0x7fd600055630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fc14bfff640 1 -- 172.21.15.57:0/2084612649 shutdown_connections 2024-09-10T11:38:45.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.637+0000 7fc14bfff640 1 -- 172.21.15.57:0/2084612649 wait complete. 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 -- 172.21.15.57:0/435111149 shutdown_connections 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 --2- 172.21.15.57:0/435111149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6514008770 0x7f6514008c20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 --2- 172.21.15.57:0/435111149 >> v2:172.21.15.154:3300/0 conn(0x7f65140395b0 0x7f6514053650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 --2- 172.21.15.57:0/435111149 >> v2:172.21.15.57:3300/0 conn(0x7f6514037be0 0x7f6514053110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 -- 172.21.15.57:0/435111149 >> 172.21.15.57:0/435111149 conn(0x7f6514056760 msgr2=0x7f6514056b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 -- 172.21.15.57:0/1926253086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c15ddf0 msgr2=0x7fcb4c0d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 --2- 172.21.15.57:0/1926253086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c15ddf0 0x7fcb4c0d0710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c08df20 tx=0x7fcb4802a480 comp rx=0 tx=0).stop 2024-09-10T11:38:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f0ec1c73640 1 -- 172.21.15.57:0/1353924746 shutdown_connections 2024-09-10T11:38:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f0ec1c73640 1 --2- 172.21.15.57:0/1353924746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ebc06ebc0 0x7f0ebc068b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f0ec1c73640 1 --2- 172.21.15.57:0/1353924746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc162110 0x7f0ebc068610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f0ec1c73640 1 -- 172.21.15.57:0/1353924746 >> 172.21.15.57:0/1353924746 conn(0x7f0ebc0d3ee0 msgr2=0x7f0ebc0d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 -- 172.21.15.57:0/435111149 shutdown_connections 2024-09-10T11:38:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 -- 172.21.15.57:0/1926253086 shutdown_connections 2024-09-10T11:38:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 --2- 172.21.15.57:0/1926253086 >> v2:172.21.15.57:3300/0 conn(0x7fcb4c0cf7b0 0x7fcb4c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 --2- 172.21.15.57:0/1926253086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c15ddf0 0x7fcb4c0d0710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 -- 172.21.15.57:0/1926253086 >> 172.21.15.57:0/1926253086 conn(0x7fcb4c09cf80 msgr2=0x7fcb4c0d3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f00ba102640 1 -- 172.21.15.57:0/2387428699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0e40a0 msgr2=0x7f00ac0e5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f00ba102640 1 --2- 172.21.15.57:0/2387428699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0e40a0 0x7f00ac0e5aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00b406adc0 tx=0x7f00b40a5b80 comp rx=0 tx=0).stop 2024-09-10T11:38:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fb5b30a9640 1 -- 172.21.15.57:0/30211190 wait complete. 2024-09-10T11:38:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f00ba102640 1 -- 172.21.15.57:0/2387428699 shutdown_connections 2024-09-10T11:38:45.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 -- 172.21.15.57:0/1926253086 shutdown_connections 2024-09-10T11:38:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f00ba102640 1 --2- 172.21.15.57:0/2387428699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac0e40a0 0x7f00ac0e5aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f00ba102640 1 -- 172.21.15.57:0/2387428699 >> 172.21.15.57:0/2387428699 conn(0x7f00ac01e000 msgr2=0x7f00ac054df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7fd607fff640 1 -- 172.21.15.57:0/1478519680 shutdown_connections 2024-09-10T11:38:45.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7fd607fff640 1 -- 172.21.15.57:0/1478519680 wait complete. 2024-09-10T11:38:45.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7f6522672640 1 -- 172.21.15.57:0/435111149 wait complete. 2024-09-10T11:38:45.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7f00ba102640 1 -- 172.21.15.57:0/2387428699 shutdown_connections 2024-09-10T11:38:45.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7f0ec1c73640 1 -- 172.21.15.57:0/1353924746 shutdown_connections 2024-09-10T11:38:45.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7f0ec1c73640 1 -- 172.21.15.57:0/1353924746 wait complete. 2024-09-10T11:38:45.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7f00ba102640 1 -- 172.21.15.57:0/2387428699 wait complete. 2024-09-10T11:38:45.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.640+0000 7fc14bfff640 1 Processor -- start 2024-09-10T11:38:45.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7fd8fe532640 1 Processor -- start 2024-09-10T11:38:45.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.639+0000 7fd8fe532640 1 -- start start 2024-09-10T11:38:45.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.640+0000 7fc14bfff640 1 -- start start 2024-09-10T11:38:45.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.640+0000 7f6522672640 1 Processor -- start 2024-09-10T11:38:45.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.640+0000 7f6522672640 1 -- start start 2024-09-10T11:38:45.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fb5b30a9640 1 Processor -- start 2024-09-10T11:38:45.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd607fff640 1 Processor -- start 2024-09-10T11:38:45.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.638+0000 7fcb53de8640 1 -- 172.21.15.57:0/1926253086 wait complete. 2024-09-10T11:38:45.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd607fff640 1 -- start start 2024-09-10T11:38:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.640+0000 7fcb53de8640 1 Processor -- start 2024-09-10T11:38:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7f00ba102640 1 Processor -- start 2024-09-10T11:38:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd8fe532640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f80cc1d0 0x7fd8f80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.640+0000 7fcb53de8640 1 -- start start 2024-09-10T11:38:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7f0ec1c73640 1 Processor -- start 2024-09-10T11:38:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd8f7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f80cc1d0 0x7fd8f80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7f0ec1c73640 1 -- start start 2024-09-10T11:38:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fc14bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c070230 0x7fc14c13e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd8f7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f80cc1d0 0x7fd8f80b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46684/0 (socket says 172.21.15.57:46684) 2024-09-10T11:38:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd8f7fff640 1 -- 172.21.15.57:0/4096975500 learned_addr learned my addr 172.21.15.57:0/4096975500 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fc14bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc14c0d0120 0x7fc14c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7fd8fe532640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80d0710 0x7fd8f8202600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc14c15fca0 0x7fc14c1f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd8fe532640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8161430 0x7fd8f8204d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f806f0d0 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.641+0000 7f00ba102640 1 -- start start 2024-09-10T11:38:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f806ef50 con 0x7fd8f80d0710 2024-09-10T11:38:45.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc14c15fca0 0x7fc14c1f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f806f250 con 0x7fd8f8161430 2024-09-10T11:38:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f6522672640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6514008770 0x7f6514021a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc14c15fca0 0x7fc14c1f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46692/0 (socket says 172.21.15.57:46692) 2024-09-10T11:38:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14b7fe640 1 -- 172.21.15.57:0/22010543 learned_addr learned my addr 172.21.15.57:0/22010543 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c1471d0 con 0x7fc14c15fca0 2024-09-10T11:38:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb53de8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c0cf7b0 0x7fcb4c14c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c070af0 con 0x7fc14c0d0120 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb53de8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c15ddf0 0x7fcb4c06dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb53de8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c09e5b0 0x7fcb4c14b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb53de8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0b7da0 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb53de8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0b7c20 con 0x7fcb4c09e5b0 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb53de8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c0b7f20 con 0x7fcb4c15ddf0 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c147350 con 0x7fc14c070230 2024-09-10T11:38:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb51b84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c0cf7b0 0x7fcb4c14c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd8fcacf640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8161430 0x7fd8f8204d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb51b84640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c0cf7b0 0x7fcb4c14c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46694/0 (socket says 172.21.15.57:46694) 2024-09-10T11:38:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd607fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600008d80 0x7fd60004f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6522672640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6514037be0 0x7f65140d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6522672640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65140395b0 0x7f651403bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6520e6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6514037be0 0x7f65140d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6520e6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6514037be0 0x7f65140d7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55796/0 (socket says 172.21.15.57:55796) 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f00ba102640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac039b40 0x7f00ac0e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f00ba102640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00ac0e3c50 0x7f00ac036e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f00ba102640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00ac0e40a0 0x7f00ac006a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f00ba102640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac0e6160 con 0x7f00ac039b40 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f00ba102640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac0e5fe0 con 0x7f00ac0e3c50 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7f00ba102640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac0e62e0 con 0x7f00ac0e40a0 2024-09-10T11:38:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f00b88ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00ac0e3c50 0x7f00ac036e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ec1c73640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc06e670 0x7f0ebc1fc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd607fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600034640 0x7fd60004a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd607fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60004a840 0x7fd6000d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd607fff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd600055070 con 0x7fd600008d80 2024-09-10T11:38:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd607fff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd600050940 con 0x7fd600034640 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd607fff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd60004acc0 con 0x7fd60004a840 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fd8f77fe640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80d0710 0x7fd8f8202600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd8f7fff640 1 -- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8161430 msgr2=0x7fd8f8204d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd8f7fff640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8161430 0x7fd8f8204d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd8f7fff640 1 -- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80d0710 msgr2=0x7fd8f8202600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd8f7fff640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80d0710 0x7fd8f8202600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd8f7fff640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f815eb50 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fb5b30a9640 1 -- start start 2024-09-10T11:38:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6520e6f640 1 -- 172.21.15.57:0/2952237882 learned_addr learned my addr 172.21.15.57:0/2952237882 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6521e71640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65140395b0 0x7f651403bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f65140547e0 con 0x7f6514008770 2024-09-10T11:38:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600008d80 0x7fd60004f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600008d80 0x7fd60004f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46718/0 (socket says 172.21.15.57:46718) 2024-09-10T11:38:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 -- 172.21.15.57:0/1335829764 learned_addr learned my addr 172.21.15.57:0/1335829764 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fc14affd640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c070230 0x7fc14c13e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6514054660 con 0x7f6514037be0 2024-09-10T11:38:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f00b88ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00ac0e3c50 0x7f00ac036e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55786/0 (socket says 172.21.15.57:55786) 2024-09-10T11:38:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6514054960 con 0x7f65140395b0 2024-09-10T11:38:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f00b9901640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00ac0e40a0 0x7f00ac006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f00b9901640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00ac0e40a0 0x7f00ac006a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:43298/0 (socket says 172.21.15.57:43298) 2024-09-10T11:38:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f00b9901640 1 -- 172.21.15.57:0/1340716309 learned_addr learned my addr 172.21.15.57:0/1340716309 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f6521670640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6514008770 0x7f6514021a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f00b9100640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac039b40 0x7f00ac0e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fc14b7fe640 1 -- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c070230 msgr2=0x7fc14c13e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fc14b7fe640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc14c070230 0x7fc14c13e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fc14b7fe640 1 -- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc14c0d0120 msgr2=0x7fc14c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fc14b7fe640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc14c0d0120 0x7fc14c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fc14b7fe640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c15e9f0 con 0x7fc14c15fca0 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ec1c73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ebc162110 0x7f0ebc15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ec1c73640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ebc15fce0 0x7f0ebc1f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ec1c73640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc06d680 con 0x7f0ebc06e670 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ec1c73640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc06d500 con 0x7f0ebc162110 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ec1c73640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc06d800 con 0x7f0ebc15fce0 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ebc162110 0x7f0ebc15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.642+0000 7fcb51b84640 1 -- 172.21.15.57:0/782861953 learned_addr learned my addr 172.21.15.57:0/782861953 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fcb51383640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c15ddf0 0x7fcb4c06dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fcb52385640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c09e5b0 0x7fcb4c14b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd6067fc640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600034640 0x7fd60004a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd6077fe640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60004a840 0x7fd6000d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ebaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ebc162110 0x7f0ebc15f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55816/0 (socket says 172.21.15.57:55816) 2024-09-10T11:38:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7f0ebaffd640 1 -- 172.21.15.57:0/372702678 learned_addr learned my addr 172.21.15.57:0/372702678 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 -- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60004a840 msgr2=0x7fd6000d89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60004a840 0x7fd6000d89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fcb51b84640 1 -- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c15ddf0 msgr2=0x7fcb4c06dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 -- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600034640 msgr2=0x7fd60004a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600034640 0x7fd60004a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.643+0000 7fd606ffd640 1 -- 172.21.15.57:0/1335829764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60004af30 con 0x7fd600008d80 2024-09-10T11:38:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fcb51b84640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb4c15ddf0 0x7fcb4c06dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebb7fe640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc06e670 0x7f0ebc1fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fcb51b84640 1 -- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c09e5b0 msgr2=0x7fcb4c14b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fcb51b84640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb4c09e5b0 0x7fcb4c14b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fcb51b84640 1 -- 172.21.15.57:0/782861953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c14cdd0 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9901640 1 -- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00ac0e3c50 msgr2=0x7f00ac036e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebaffd640 1 -- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ebc15fce0 msgr2=0x7f0ebc1f79b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:38:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebaffd640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ebc15fce0 0x7f0ebc1f79b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebaffd640 1 -- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc06e670 msgr2=0x7f0ebc1fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebaffd640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ebc06e670 0x7f0ebc1fc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f6521670640 1 -- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65140395b0 msgr2=0x7f651403bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f6521670640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65140395b0 0x7f651403bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f6521670640 1 -- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6514037be0 msgr2=0x7f65140d7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f6521670640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6514037be0 0x7f65140d7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f6521670640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651417cd70 con 0x7f6514008770 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebaffd640 1 -- 172.21.15.57:0/372702678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc1526f0 con 0x7f0ebc162110 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd8f7fff640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f80cc1d0 0x7fd8f80b4e90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800b780 tx=0x7fd8e800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b30a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac06ce10 0x7fb5ac153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9901640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00ac0e3c50 0x7f00ac036e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9901640 1 -- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac039b40 msgr2=0x7f00ac0e1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9901640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac039b40 0x7f00ac0e1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9901640 1 -- 172.21.15.57:0/1340716309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac04a970 con 0x7f00ac0e40a0 2024-09-10T11:38:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b88ff640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00ac0e3c50 0x7f00ac036e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b30a9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5ac0cdb40 0x7fb5ac15e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b30a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9100640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00ac039b40 0x7f00ac0e1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fc14b7fe640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc14c15fca0 0x7fc14c1f78c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc14400cbf0 tx=0x7fc14400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b30a9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac0d0660 con 0x7fb5ac06ce10 2024-09-10T11:38:45.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd606ffd640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600008d80 0x7fd60004f150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80046b0 tx=0x7fd5f800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b30a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac0d04e0 con 0x7fb5ac15ba00 2024-09-10T11:38:45.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b30a9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac0cf120 con 0x7fb5ac0cdb40 2024-09-10T11:38:45.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fcb51b84640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c0cf7b0 0x7fcb4c14c890 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb480098f0 tx=0x7fcb480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ebaffd640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ebc162110 0x7f0ebc15f7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00d7a0 tx=0x7f0eac00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f6521670640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6514008770 0x7f6514021a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f651c06b4b0 tx=0x7f651c06a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b1646640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144016020 con 0x7fc14c15fca0 2024-09-10T11:38:45.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b1646640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac15eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55822/0 (socket says 172.21.15.57:55822) 2024-09-10T11:38:45.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b1646640 1 -- 172.21.15.57:0/2573200901 learned_addr learned my addr 172.21.15.57:0/2573200901 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5b0e45640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac06ce10 0x7fb5ac153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fb5abfff640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5ac0cdb40 0x7fb5ac15e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f00b9901640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00ac0e40a0 0x7f00ac006a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00b406be50 tx=0x7f00b40af790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8019070 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8e800c830 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f815ee30 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5b1646640 1 -- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5ac0cdb40 msgr2=0x7fb5ac15e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5b1646640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5ac0cdb40 0x7fb5ac15e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c15ecd0 con 0x7fc14c15fca0 2024-09-10T11:38:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c15f780 con 0x7fc14c15fca0 2024-09-10T11:38:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40c2070 con 0x7f00ac0e40a0 2024-09-10T11:38:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5b1646640 1 -- 172.21.15.57:0/2573200901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac06ce10 msgr2=0x7fb5ac153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5b1646640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac06ce10 0x7fb5ac153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5b1646640 1 -- 172.21.15.57:0/2573200901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac0c7ed0 con 0x7fb5ac15ba00 2024-09-10T11:38:45.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f815f3f0 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c093600 con 0x7f6514008770 2024-09-10T11:38:45.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800cc80 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f651c0938f0 con 0x7f6514008770 2024-09-10T11:38:45.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac017070 con 0x7f0ebc162110 2024-09-10T11:38:45.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eac009d20 con 0x7f0ebc162110 2024-09-10T11:38:45.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5b1646640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac15eb00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400b9e0 tx=0x7fb5a400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8016020 con 0x7fd600008d80 2024-09-10T11:38:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0106c0 con 0x7f0ebc162110 2024-09-10T11:38:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f0ec1c73640 1 -- 172.21.15.57:0/372702678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc151e50 con 0x7f0ebc162110 2024-09-10T11:38:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5f800a860 con 0x7fd600008d80 2024-09-10T11:38:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60004b210 con 0x7fd600008d80 2024-09-10T11:38:45.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f0ec1c73640 1 -- 172.21.15.57:0/372702678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc152410 con 0x7f0ebc162110 2024-09-10T11:38:45.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.644+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60004b7d0 con 0x7fd600008d80 2024-09-10T11:38:45.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00b40ba440 con 0x7f00ac0e40a0 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f00ba102640 1 -- 172.21.15.57:0/1340716309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac04ac50 con 0x7f00ac0e40a0 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7f00ba102640 1 -- 172.21.15.57:0/1340716309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac04b210 con 0x7f00ac0e40a0 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40c2070 con 0x7f00ac0e40a0 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4019070 con 0x7fb5ac15ba00 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.645+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5a400cc10 con 0x7fb5ac15ba00 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40146a0 con 0x7fb5ac15ba00 2024-09-10T11:38:45.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48031600 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800ac90 con 0x7fd600008d80 2024-09-10T11:38:45.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac0c81b0 con 0x7fb5ac15ba00 2024-09-10T11:38:45.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac0c8770 con 0x7fb5ac15ba00 2024-09-10T11:38:45.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c093dc0 con 0x7f6514008770 2024-09-10T11:38:45.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6514179d50 con 0x7f6514008770 2024-09-10T11:38:45.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651417a590 con 0x7f6514008770 2024-09-10T11:38:45.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc14400acf0 con 0x7fc14c15fca0 2024-09-10T11:38:45.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144012680 con 0x7fc14c15fca0 2024-09-10T11:38:45.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc14c146ac0 con 0x7fc14c15fca0 2024-09-10T11:38:45.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.647+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6514008c20 con 0x7f6514008770 2024-09-10T11:38:45.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.647+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8d8001030 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7fcb53de8640 1 -- 172.21.15.57:0/782861953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c0a10a0 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.647+0000 7fcb53de8640 1 -- 172.21.15.57:0/782861953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c14a4e0 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.647+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb48031c90 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.647+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48031e60 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.647+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd600050e10 con 0x7fd600008d80 2024-09-10T11:38:45.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.646+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00ac0e5aa0 con 0x7f00ac0e40a0 2024-09-10T11:38:45.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.648+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5ac0cf6c0 con 0x7fb5ac15ba00 2024-09-10T11:38:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.648+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb4c0b8440 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.648+0000 7f0ec1c73640 1 -- 172.21.15.57:0/372702678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ebc0d35a0 con 0x7f0ebc162110 2024-09-10T11:38:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.649+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0eac01a070 con 0x7f0ebc162110 2024-09-10T11:38:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.649+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd8e801c070 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.649+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb5a401c070 con 0x7fb5ac15ba00 2024-09-10T11:38:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.649+0000 7fb5a97fa640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5900751a0 0x7fb590077660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb5a4096080 con 0x7fb5ac15ba00 2024-09-10T11:38:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f651c09d3f0 con 0x7f6514008770 2024-09-10T11:38:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fb5a97fa640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7fb59007d340 0x7fb59007f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 --> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb59007fe10 con 0x7fb59007d340 2024-09-10T11:38:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb5a409d050 con 0x7fb5ac15ba00 2024-09-10T11:38:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ea3fff640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0ea8075170 0x7f0ea8077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0eac096540 con 0x7f0ebc162110 2024-09-10T11:38:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ebb7fe640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0ea8075170 0x7f0ea8077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fd8f4ff9640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8e40751a0 0x7fd8e4077660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fb5b0e45640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5900751a0 0x7fb590077660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fb5abfff640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7fb59007d340 0x7fb59007f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ea3fff640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7f0ea807d370 0x7f0ea807f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 --> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0eac021e80 con 0x7f0ea807d370 2024-09-10T11:38:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0eac09d050 con 0x7f0ebc162110 2024-09-10T11:38:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7fd8f77fe640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8e40751a0 0x7fd8e4077660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.650+0000 7f0ebbfff640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7f0ea807d370 0x7f0ea807f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8e8095c70 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6511ffb640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6500075170 0x7f6500077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd5f8019020 con 0x7fd600008d80 2024-09-10T11:38:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f651c111250 con 0x7f6514008770 2024-09-10T11:38:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6520e6f640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6500075170 0x7f6500077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6511ffb640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7f650007d390 0x7f650007f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7fb5abfff640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7fb59007d340 0x7fb59007f760 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f0ebbfff640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7f0ea807d370 0x7f0ea807f790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f650007fe60 con 0x7f650007d390 2024-09-10T11:38:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f651c1115f0 con 0x7f6514008770 2024-09-10T11:38:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7fd8f77fe640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8e40751a0 0x7fd8e4077660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec034000 tx=0x7fd8ec004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6521e71640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7f650007d390 0x7f650007f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd8f4ff9640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7fd8e407d340 0x7fd8e407f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f00b40a7900 con 0x7f00ac0e40a0 2024-09-10T11:38:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8e407fe10 con 0x7fd8e407d340 2024-09-10T11:38:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd8e805c150 con 0x7fd8f80cc1d0 2024-09-10T11:38:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7fd5ef7fe640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd5f40750f0 0x7fd5f40775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5f8096350 con 0x7fd600008d80 2024-09-10T11:38:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd5ef7fe640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fd5f407d2f0 0x7fd5f407f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 --> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5f8019ec0 con 0x7fd5f407d2f0 2024-09-10T11:38:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd5f8096780 con 0x7fd600008d80 2024-09-10T11:38:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd8fcacf640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7fd8e407d340 0x7fd8e407f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f6520e6f640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6500075170 0x7f6500077630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65140244e0 tx=0x7f650c00b390 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd6067fc640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd5f40750f0 0x7fd5f40775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== osd.7 v2:172.21.15.154:6808/2303779163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb59007fe10 con 0x7fb59007d340 2024-09-10T11:38:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fc144019020 con 0x7fc14c15fca0 2024-09-10T11:38:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7f6521e71640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7f650007d390 0x7f650007f7b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7f00a5ffb640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f00980754a0 0x7f0098077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fcb48005280 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7fd6077fe640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fd5f407d2f0 0x7fd5f407f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fb5b0e45640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5900751a0 0x7fb590077660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0033000 tx=0x7fb5a0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f00b40afbd0 con 0x7f00ac0e40a0 2024-09-10T11:38:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f00b9100640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f00980754a0 0x7f0098077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fd6067fc640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd5f40750f0 0x7fd5f40775b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc034000 tx=0x7fd5fc004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fd8fcacf640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7fd8e407d340 0x7fd8e407f760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f00a5ffb640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f009807d6a0 0x7f009807fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 --> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0098080170 con 0x7f009807d6a0 2024-09-10T11:38:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f00b4131ed0 con 0x7f00ac0e40a0 2024-09-10T11:38:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fc143fff640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc12c075170 0x7fc12c077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fcb427fc640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb30075170 0x7fcb30077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc144097000 con 0x7fc14c15fca0 2024-09-10T11:38:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fc14affd640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc12c075170 0x7fc12c077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== osd.1 v2:172.21.15.57:6808/1756241264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f650007fe60 con 0x7f650007d390 2024-09-10T11:38:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7f00b88ff640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f009807d6a0 0x7f009807fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fc143fff640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fc12c07d390 0x7fc12c07f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc144010e50 con 0x7fc12c07d390 2024-09-10T11:38:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1440973a0 con 0x7fc14c15fca0 2024-09-10T11:38:45.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb480b79d0 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fcb51383640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb30075170 0x7fcb30077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.651+0000 7f0ebb7fe640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0ea8075170 0x7f0ea8077630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0033000 tx=0x7f0eb00046c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.652+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== osd.3 v2:172.21.15.57:6800/2364480318 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0eac021e80 con 0x7f0ea807d370 2024-09-10T11:38:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fcb427fc640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7fcb3007d390 0x7fcb3007f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 --> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb3007fe60 con 0x7fcb3007d390 2024-09-10T11:38:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb480b7d70 con 0x7fcb4c0cf7b0 2024-09-10T11:38:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7f00b9100640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f00980754a0 0x7f0098077960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001770 tx=0x7f00a8009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.653+0000 7fd6077fe640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fd5f407d2f0 0x7fd5f407f710 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fcb52385640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7fcb3007d390 0x7fcb3007f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fc1427fc640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fc12c07d390 0x7fc12c07f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7f00b88ff640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f009807d6a0 0x7f009807fac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fc1427fc640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fc12c07d390 0x7fc12c07f7b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fcb51383640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb30075170 0x7fcb30077630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c007fd0 tx=0x7fcb3c009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== osd.5 v2:172.21.15.154:6826/4034291138 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5f8019ec0 con 0x7fd5f407d2f0 2024-09-10T11:38:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fcb52385640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7fcb3007d390 0x7fcb3007f7b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.654+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== osd.6 v2:172.21.15.154:6818/2363284508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8e407fe10 con 0x7fd8e407d340 2024-09-10T11:38:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.655+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== osd.2 v2:172.21.15.57:6816/292362606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0098080170 con 0x7f009807d6a0 2024-09-10T11:38:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.655+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== osd.0 v2:172.21.15.57:6824/2685346277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc144010e50 con 0x7fc12c07d390 2024-09-10T11:38:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.655+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== osd.4 v2:172.21.15.154:6800/3245795650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb3007fe60 con 0x7fcb3007d390 2024-09-10T11:38:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.655+0000 7fc14affd640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc12c075170 0x7fc12c077630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc13c034000 tx=0x7fc13c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.685+0000 7f0ec1c73640 1 -- 172.21.15.57:0/372702678 --> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ebc1fcb60 con 0x7f0ea807d370 2024-09-10T11:38:45.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.685+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 --> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6514052ef0 con 0x7f650007d390 2024-09-10T11:38:45.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.685+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 --> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5ac0c8b10 con 0x7fb59007d340 2024-09-10T11:38:45.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.685+0000 7f0ea3fff640 1 -- 172.21.15.57:0/372702678 <== osd.3 v2:172.21.15.57:6800/2364480318 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ebc1fcb60 con 0x7f0ea807d370 2024-09-10T11:38:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7f0ea807d370 msgr2=0x7f0ea807f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7f0ea807d370 0x7f0ea807f790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0ea8075170 msgr2=0x7f0ea8077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0ea8075170 0x7f0ea8077630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0033000 tx=0x7f0eb00046c0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ebc162110 msgr2=0x7f0ebc15f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 --2- 172.21.15.57:0/372702678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ebc162110 0x7f0ebc15f7a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00d7a0 tx=0x7f0eac00dc60 comp rx=0 tx=0).stop 2024-09-10T11:38:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ebbfff640 1 -- 172.21.15.57:0/372702678 reap_dead start 2024-09-10T11:38:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 shutdown_connections 2024-09-10T11:38:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 >> 172.21.15.57:0/372702678 conn(0x7f0ebc0d3ee0 msgr2=0x7f0ebc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f6511ffb640 1 -- 172.21.15.57:0/2952237882 <== osd.1 v2:172.21.15.57:6808/1756241264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6514052ef0 con 0x7f650007d390 2024-09-10T11:38:45.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 --> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8d8002dd0 con 0x7fd8e407d340 2024-09-10T11:38:45.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 shutdown_connections 2024-09-10T11:38:45.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7f650007d390 msgr2=0x7f650007f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f6522672640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7f650007d390 0x7f650007f7b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7f0ea1ffb640 1 -- 172.21.15.57:0/372702678 wait complete. 2024-09-10T11:38:45.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.686+0000 7fb5a97fa640 1 -- 172.21.15.57:0/2573200901 <== osd.7 v2:172.21.15.154:6808/2303779163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5ac0c8b10 con 0x7fb59007d340 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6500075170 msgr2=0x7f6500077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6500075170 0x7f6500077630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65140244e0 tx=0x7f650c00b390 comp rx=0 tx=0).stop 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6514008770 msgr2=0x7f6514021a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 --2- 172.21.15.57:0/2952237882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6514008770 0x7f6514021a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f651c06b4b0 tx=0x7f651c06a0d0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6521e71640 1 -- 172.21.15.57:0/2952237882 reap_dead start 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 shutdown_connections 2024-09-10T11:38:45.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 >> 172.21.15.57:0/2952237882 conn(0x7f6514056760 msgr2=0x7f651400d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 shutdown_connections 2024-09-10T11:38:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f6522672640 1 -- 172.21.15.57:0/2952237882 wait complete. 2024-09-10T11:38:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7fb59007d340 msgr2=0x7fb59007f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b30a9640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7fb59007d340 0x7fb59007f760 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5900751a0 msgr2=0x7fb590077660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b30a9640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5900751a0 0x7fb590077660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0033000 tx=0x7fb5a0004730 comp rx=0 tx=0).stop 2024-09-10T11:38:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 --> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00ac022c60 con 0x7f009807d6a0 2024-09-10T11:38:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 msgr2=0x7fb5ac15eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fd8f4ff9640 1 -- 172.21.15.57:0/4096975500 <== osd.6 v2:172.21.15.154:6818/2363284508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8d8002dd0 con 0x7fd8e407d340 2024-09-10T11:38:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b30a9640 1 --2- 172.21.15.57:0/2573200901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ac15ba00 0x7fb5ac15eb00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400b9e0 tx=0x7fb5a400bea0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.687+0000 7fb5b1646640 1 -- 172.21.15.57:0/2573200901 reap_dead start 2024-09-10T11:38:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 --> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd600050e10 con 0x7fd5f407d2f0 2024-09-10T11:38:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 shutdown_connections 2024-09-10T11:38:45.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 >> 172.21.15.57:0/2573200901 conn(0x7fb5ac0b24d0 msgr2=0x7fb5ac0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7f00a5ffb640 1 -- 172.21.15.57:0/1340716309 <== osd.2 v2:172.21.15.57:6816/292362606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00ac022c60 con 0x7f009807d6a0 2024-09-10T11:38:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7fd8e407d340 msgr2=0x7fd8e407f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7fd8e407d340 0x7fd8e407f760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 shutdown_connections 2024-09-10T11:38:45.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fb5b30a9640 1 -- 172.21.15.57:0/2573200901 wait complete. 2024-09-10T11:38:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 --> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc14c146ac0 con 0x7fc12c07d390 2024-09-10T11:38:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fc143fff640 1 -- 172.21.15.57:0/22010543 <== osd.0 v2:172.21.15.57:6824/2685346277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc14c146ac0 con 0x7fc12c07d390 2024-09-10T11:38:45.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd5ef7fe640 1 -- 172.21.15.57:0/1335829764 <== osd.5 v2:172.21.15.154:6826/4034291138 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd600050e10 con 0x7fd5f407d2f0 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8e40751a0 msgr2=0x7fd8e4077660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8e40751a0 0x7fd8e4077660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec034000 tx=0x7fd8ec004730 comp rx=0 tx=0).stop 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f80cc1d0 msgr2=0x7fd8f80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 --2- 172.21.15.57:0/4096975500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8f80cc1d0 0x7fd8f80b4e90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800b780 tx=0x7fd8e800bc40 comp rx=0 tx=0).stop 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fcacf640 1 -- 172.21.15.57:0/4096975500 reap_dead start 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 shutdown_connections 2024-09-10T11:38:45.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.688+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 >> 172.21.15.57:0/4096975500 conn(0x7fd8f809aa20 msgr2=0x7fd8f80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 shutdown_connections 2024-09-10T11:38:45.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd8fe532640 1 -- 172.21.15.57:0/4096975500 wait complete. 2024-09-10T11:38:45.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f009807d6a0 msgr2=0x7f009807fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f009807d6a0 0x7f009807fac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f00980754a0 msgr2=0x7f0098077960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f00980754a0 0x7f0098077960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001770 tx=0x7f00a8009040 comp rx=0 tx=0).stop 2024-09-10T11:38:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00ac0e40a0 msgr2=0x7f00ac006a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 --2- 172.21.15.57:0/1340716309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00ac0e40a0 0x7f00ac006a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00b406be50 tx=0x7f00b40af790 comp rx=0 tx=0).stop 2024-09-10T11:38:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00b9901640 1 -- 172.21.15.57:0/1340716309 reap_dead start 2024-09-10T11:38:45.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 --> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcb4c0b93e0 con 0x7fcb3007d390 2024-09-10T11:38:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fd5f407d2f0 msgr2=0x7fd5f407f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fd5f407d2f0 0x7fd5f407f710 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd5f40750f0 msgr2=0x7fd5f40775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd5f40750f0 0x7fd5f40775b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc034000 tx=0x7fd5fc004730 comp rx=0 tx=0).stop 2024-09-10T11:38:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600008d80 msgr2=0x7fd60004f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 --2- 172.21.15.57:0/1335829764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd600008d80 0x7fd60004f150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80046b0 tx=0x7fd5f800cb90 comp rx=0 tx=0).stop 2024-09-10T11:38:45.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd6077fe640 1 -- 172.21.15.57:0/1335829764 reap_dead start 2024-09-10T11:38:45.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 shutdown_connections 2024-09-10T11:38:45.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 >> 172.21.15.57:0/1340716309 conn(0x7f00ac01e000 msgr2=0x7f00ac00aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 shutdown_connections 2024-09-10T11:38:45.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fc12c07d390 msgr2=0x7fc12c07f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 >> 172.21.15.57:0/1335829764 conn(0x7fd60001e880 msgr2=0x7fd6000374e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.689+0000 7fc14bfff640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fc12c07d390 0x7fc12c07f7b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 shutdown_connections 2024-09-10T11:38:45.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fcb427fc640 1 -- 172.21.15.57:0/782861953 <== osd.4 v2:172.21.15.154:6800/3245795650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcb4c0b93e0 con 0x7fcb3007d390 2024-09-10T11:38:45.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7f00977fe640 1 -- 172.21.15.57:0/1340716309 wait complete. 2024-09-10T11:38:45.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc12c075170 msgr2=0x7fc12c077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc12c075170 0x7fc12c077630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc13c034000 tx=0x7fc13c004730 comp rx=0 tx=0).stop 2024-09-10T11:38:45.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc14c15fca0 msgr2=0x7fc14c1f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 --2- 172.21.15.57:0/22010543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc14c15fca0 0x7fc14c1f78c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc14400cbf0 tx=0x7fc14400a430 comp rx=0 tx=0).stop 2024-09-10T11:38:45.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 shutdown_connections 2024-09-10T11:38:45.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fd607fff640 1 -- 172.21.15.57:0/1335829764 wait complete. 2024-09-10T11:38:45.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14b7fe640 1 -- 172.21.15.57:0/22010543 reap_dead start 2024-09-10T11:38:45.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 shutdown_connections 2024-09-10T11:38:45.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 >> 172.21.15.57:0/22010543 conn(0x7fc14c0b25b0 msgr2=0x7fc14c0730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7fcb3007d390 msgr2=0x7fcb3007f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fcb2ffff640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7fcb3007d390 0x7fcb3007f7b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.690+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 shutdown_connections 2024-09-10T11:38:45.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fc14bfff640 1 -- 172.21.15.57:0/22010543 wait complete. 2024-09-10T11:38:45.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb30075170 msgr2=0x7fcb30077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcb30075170 0x7fcb30077630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c007fd0 tx=0x7fcb3c009040 comp rx=0 tx=0).stop 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c0cf7b0 msgr2=0x7fcb4c14c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 --2- 172.21.15.57:0/782861953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb4c0cf7b0 0x7fcb4c14c890 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb480098f0 tx=0x7fcb480045e0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb52385640 1 -- 172.21.15.57:0/782861953 reap_dead start 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 shutdown_connections 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 >> 172.21.15.57:0/782861953 conn(0x7fcb4c09cf80 msgr2=0x7fcb4c160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 shutdown_connections 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.691+0000 7fcb2ffff640 1 -- 172.21.15.57:0/782861953 wait complete. 2024-09-10T11:38:45.735 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-09-10T11:38:45.736 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:45.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T11:38:45.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T11:38:45.738 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:45.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T11:38:45.739 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-09-10T11:38:45.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T11:38:45.740 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:45.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T11:38:45.741 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-09-10T11:38:45.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T11:38:45.742 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-09-10T11:38:45.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T11:38:45.743 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2024-09-10T11:38:45.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T11:38:45.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.955+0000 7f15cd59a640 1 -- 172.21.15.57:0/3593768010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c802fbb0 con 0x7f15d015fc50 2024-09-10T11:38:45.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.955+0000 7f15d4ad4640 1 -- 172.21.15.57:0/3593768010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 msgr2=0x7f15d00ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.955+0000 7f15d4ad4640 1 --2- 172.21.15.57:0/3593768010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00ceae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f15d00cf6e0 tx=0x7f15c802a9c0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 -- 172.21.15.57:0/3593768010 shutdown_connections 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 --2- 172.21.15.57:0/3593768010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00ceae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 --2- 172.21.15.57:0/3593768010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15d015f7e0 0x7f15d00ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 --2- 172.21.15.57:0/3593768010 >> v2:172.21.15.154:3300/0 conn(0x7f15d00d1a70 0x7f15d00d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 -- 172.21.15.57:0/3593768010 >> 172.21.15.57:0/3593768010 conn(0x7f15d009aa20 msgr2=0x7f15d009ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 -- 172.21.15.57:0/3593768010 shutdown_connections 2024-09-10T11:38:45.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.956+0000 7f15d4ad4640 1 -- 172.21.15.57:0/3593768010 wait complete. 2024-09-10T11:38:45.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.958+0000 7f15d4ad4640 1 Processor -- start 2024-09-10T11:38:45.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.958+0000 7f15d4ad4640 1 -- start start 2024-09-10T11:38:45.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.959+0000 7f15d4ad4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15d00d1a70 0x7f15d00c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.959+0000 7f15d4ad4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 0x7f15d00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.960+0000 7f15d4ad4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.960+0000 7f15cdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 0x7f15d00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.960+0000 7f15cdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 0x7f15d00c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55844/0 (socket says 172.21.15.57:55844) 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.960+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.960+0000 7f15ced9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46792/0 (socket says 172.21.15.57:46792) 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.960+0000 7f15cdd9b640 1 -- 172.21.15.57:0/2706380350 learned_addr learned my addr 172.21.15.57:0/2706380350 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.961+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015b350 con 0x7f15d015fc50 2024-09-10T11:38:45.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.961+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15d015b1d0 con 0x7f15d015f7e0 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.961+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f15d015b4d0 con 0x7f15d00d1a70 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.961+0000 7f15ce59c640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15d00d1a70 0x7f15d00c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15cdd9b640 1 -- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15d00d1a70 msgr2=0x7f15d00c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15cdd9b640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15d00d1a70 0x7f15d00c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15cdd9b640 1 -- 172.21.15.57:0/2706380350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 msgr2=0x7f15d00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15cdd9b640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15cdd9b640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d00c9770 con 0x7f15d015f7e0 2024-09-10T11:38:45.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15ced9d640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:45.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f9f87d75640 1 -- 172.21.15.57:0/2102494614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f8015a870 msgr2=0x7f9f800705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f9f87d75640 1 --2- 172.21.15.57:0/2102494614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f8015a870 0x7f9f800705b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9f800c7a00 tx=0x7f9f7002a540 comp rx=0 tx=0).stop 2024-09-10T11:38:45.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f15cdd9b640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 0x7f15d00c79e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b450 tx=0x7f15c400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f9f87d75640 1 -- 172.21.15.57:0/2102494614 shutdown_connections 2024-09-10T11:38:45.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f9f87d75640 1 --2- 172.21.15.57:0/2102494614 >> v2:172.21.15.154:3300/0 conn(0x7f9f80070af0 0x7f9f800cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f9f87d75640 1 --2- 172.21.15.57:0/2102494614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f8015a870 0x7f9f800705b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.962+0000 7f9f87d75640 1 -- 172.21.15.57:0/2102494614 >> 172.21.15.57:0/2102494614 conn(0x7f9f800b2540 msgr2=0x7f9f800b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.963+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4015020 con 0x7f15d015f7e0 2024-09-10T11:38:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.963+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15c40119a0 con 0x7f15d015f7e0 2024-09-10T11:38:45.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.963+0000 7f9f87d75640 1 -- 172.21.15.57:0/2102494614 shutdown_connections 2024-09-10T11:38:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.963+0000 7f9f87d75640 1 -- 172.21.15.57:0/2102494614 wait complete. 2024-09-10T11:38:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.963+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4011df0 con 0x7f15d015f7e0 2024-09-10T11:38:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.963+0000 7fa59ffff640 1 -- 172.21.15.57:0/2753618458 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598032b80 con 0x7fa5a015ee00 2024-09-10T11:38:45.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d00c9a50 con 0x7f15d015f7e0 2024-09-10T11:38:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01540f0 con 0x7f15d015f7e0 2024-09-10T11:38:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fec3dffb640 1 -- 172.21.15.57:0/3235615322 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30014cd0 con 0x7fec28003a30 2024-09-10T11:38:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 -- 172.21.15.57:0/2753618458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a015ee00 msgr2=0x7fa5a0157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 --2- 172.21.15.57:0/2753618458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a015ee00 0x7fa5a0157ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa598009860 tx=0x7fa59802a4b0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 -- 172.21.15.57:0/2753618458 shutdown_connections 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 --2- 172.21.15.57:0/2753618458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a015ee00 0x7fa5a0157ca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 -- 172.21.15.57:0/2753618458 >> 172.21.15.57:0/2753618458 conn(0x7fa5a006d1e0 msgr2=0x7fa5a00b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 -- 172.21.15.57:0/2753618458 shutdown_connections 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7fa5a7564640 1 -- 172.21.15.57:0/2753618458 wait complete. 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7f0b670a9640 1 -- 172.21.15.57:0/16993950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600cd2f0 msgr2=0x7f0b60070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.964+0000 7f0b670a9640 1 --2- 172.21.15.57:0/16993950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600cd2f0 0x7f0b60070790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b6015f330 tx=0x7f0b5802aa10 comp rx=0 tx=0).stop 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f0b670a9640 1 -- 172.21.15.57:0/16993950 shutdown_connections 2024-09-10T11:38:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f0b670a9640 1 --2- 172.21.15.57:0/16993950 >> v2:172.21.15.57:3300/0 conn(0x7f0b600739f0 0x7f0b6015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f0b670a9640 1 --2- 172.21.15.57:0/16993950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600cd2f0 0x7f0b60070790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f0b670a9640 1 -- 172.21.15.57:0/16993950 >> 172.21.15.57:0/16993950 conn(0x7f0b600b2690 msgr2=0x7f0b600b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f9f87d75640 1 Processor -- start 2024-09-10T11:38:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7fec3ffff640 1 -- 172.21.15.57:0/3235615322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 msgr2=0x7fec28003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f9f87d75640 1 -- start start 2024-09-10T11:38:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 -- 172.21.15.57:0/4207078283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8008d70 msgr2=0x7f06e8054760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f0b670a9640 1 -- 172.21.15.57:0/16993950 shutdown_connections 2024-09-10T11:38:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 --2- 172.21.15.57:0/4207078283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8008d70 0x7f06e8054760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009830 tx=0x7f06ec02a440 comp rx=0 tx=0).stop 2024-09-10T11:38:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7fec3ffff640 1 --2- 172.21.15.57:0/3235615322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec28003e30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec300095b0 tx=0x7fec28005830 comp rx=0 tx=0).stop 2024-09-10T11:38:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 -- 172.21.15.57:0/4207078283 shutdown_connections 2024-09-10T11:38:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7fec3f7fe640 1 -- 172.21.15.57:0/3235615322 reap_dead start 2024-09-10T11:38:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 --2- 172.21.15.57:0/4207078283 >> v2:172.21.15.57:3300/0 conn(0x7f06e8050d10 0x7f06e8054ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 --2- 172.21.15.57:0/4207078283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8008d70 0x7f06e8054760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 -- 172.21.15.57:0/4207078283 >> 172.21.15.57:0/4207078283 conn(0x7f06e801e890 msgr2=0x7f06e8055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 -- 172.21.15.57:0/4207078283 shutdown_connections 2024-09-10T11:38:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f06f8695640 1 -- 172.21.15.57:0/4207078283 wait complete. 2024-09-10T11:38:45.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fec3ffff640 1 -- 172.21.15.57:0/3235615322 shutdown_connections 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fec3ffff640 1 -- 172.21.15.57:0/3235615322 >> 172.21.15.57:0/3235615322 conn(0x7fec400b1430 msgr2=0x7fec400b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fec3ffff640 1 -- 172.21.15.57:0/3235615322 shutdown_connections 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f87d75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f80070af0 0x7f9f800c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f87d75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 0x7f9f80151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f87d75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f8015a870 0x7f9f800c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f87d75640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8015ae70 con 0x7f9f800cf340 2024-09-10T11:38:45.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f87d75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f800cd510 con 0x7f9f80070af0 2024-09-10T11:38:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f87d75640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9f80073910 con 0x7f9f8015a870 2024-09-10T11:38:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f9f85310640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 0x7f9f80151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f15c4018020 con 0x7f15d015f7e0 2024-09-10T11:38:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 0x7f9f80151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46808/0 (socket says 172.21.15.57:46808) 2024-09-10T11:38:45.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 -- 172.21.15.57:0/3535439927 learned_addr learned my addr 172.21.15.57:0/3535439927 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85b11640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f80070af0 0x7f9f800c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f86312640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f8015a870 0x7f9f800c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d00d1e50 con 0x7f15d015f7e0 2024-09-10T11:38:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7f0b670a9640 1 -- 172.21.15.57:0/16993950 wait complete. 2024-09-10T11:38:45.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f0b670a9640 1 Processor -- start 2024-09-10T11:38:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f0b670a9640 1 -- start start 2024-09-10T11:38:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 -- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f8015a870 msgr2=0x7f9f800c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f8015a870 0x7f9f800c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 -- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f80070af0 msgr2=0x7f9f800c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f80070af0 0x7f9f800c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 -- 172.21.15.57:0/3535439927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8015caf0 con 0x7f9f800cf340 2024-09-10T11:38:45.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f15beffd640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15b00750a0 0x7f15b0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f06f8695640 1 Processor -- start 2024-09-10T11:38:45.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f06f8695640 1 -- start start 2024-09-10T11:38:45.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.967+0000 7f9f85310640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 0x7f9f80151ff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.965+0000 7fad0b7fe640 1 -- 172.21.15.57:0/1566438356 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf80047a0 con 0x7fad04055dd0 2024-09-10T11:38:45.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fad11f8a640 1 -- 172.21.15.57:0/1566438356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 msgr2=0x7fad04052390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fad11f8a640 1 --2- 172.21.15.57:0/1566438356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad04052390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad0401ed90 tx=0x7facf802a4f0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f15ce59c640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15b00750a0 0x7f15b0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15c4096150 con 0x7f15d015f7e0 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fa5a7564640 1 Processor -- start 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fa5a7564640 1 -- start start 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a7564640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a0074260 0x7fa5a020da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a7564640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 0x7fa5a01558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a7564640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5a015ee00 0x7fa5a020c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a7564640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a016d5d0 con 0x7fa5a00b3630 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a7564640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a01586a0 con 0x7fa5a015ee00 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a7564640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a016d750 con 0x7fa5a0074260 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 0x7fa5a01558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 0x7fa5a01558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46822/0 (socket says 172.21.15.57:46822) 2024-09-10T11:38:45.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 -- 172.21.15.57:0/3539203225 learned_addr learned my addr 172.21.15.57:0/3539203225 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.966+0000 7fec3ffff640 1 -- 172.21.15.57:0/3235615322 wait complete. 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7fec3ffff640 1 Processor -- start 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7fec3ffff640 1 -- start start 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00cd80 con 0x7f9f800cf340 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f7c004020 con 0x7f9f800cf340 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8015cdd0 con 0x7f9f800cf340 2024-09-10T11:38:45.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c004450 con 0x7f9f800cf340 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8015d390 con 0x7f9f800cf340 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7fad11f8a640 1 -- 172.21.15.57:0/1566438356 shutdown_connections 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7fad11f8a640 1 --2- 172.21.15.57:0/1566438356 >> v2:172.21.15.154:3300/0 conn(0x7fad04008ba0 0x7fad0404fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7fad11f8a640 1 --2- 172.21.15.57:0/1566438356 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad04052390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7fad11f8a640 1 -- 172.21.15.57:0/1566438356 >> 172.21.15.57:0/1566438356 conn(0x7fad0401e8d0 msgr2=0x7fad040556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fad11f8a640 1 -- 172.21.15.57:0/1566438356 shutdown_connections 2024-09-10T11:38:45.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f06f8695640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e8008d70 0x7f06e804c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f06f8695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 0x7f06e80e1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f06f8695640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8050d10 0x7f06e817d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f06f8695640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80349e0 con 0x7f06e8008d70 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f06f8695640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8034860 con 0x7f06e8034ba0 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f06f8695640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f06e803a500 con 0x7f06e8050d10 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f06f6431640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e8008d70 0x7f06e804c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f06f5c30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 0x7f06e80e1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 -- 172.21.15.57:0/608698050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 msgr2=0x7f41b4073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 --2- 172.21.15.57:0/608698050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 0x7f41b4073e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009860 tx=0x7f41a402a510 comp rx=0 tx=0).stop 2024-09-10T11:38:45.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41b91a2640 1 -- 172.21.15.57:0/608698050 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4031bf0 con 0x7f41b415ade0 2024-09-10T11:38:45.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.968+0000 7f15ce59c640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15b00750a0 0x7f15b0077560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15d00d2640 tx=0x7f15c00090e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a5300640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a0074260 0x7fa5a020da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f06f5c30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 0x7f06e80e1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55902/0 (socket says 172.21.15.57:55902) 2024-09-10T11:38:45.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f06f5c30640 1 -- 172.21.15.57:0/2747862749 learned_addr learned my addr 172.21.15.57:0/2747862749 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f06f6c32640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8050d10 0x7f06e817d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 -- 172.21.15.57:0/608698050 shutdown_connections 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 --2- 172.21.15.57:0/608698050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 0x7f41b4073e10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 -- 172.21.15.57:0/608698050 >> 172.21.15.57:0/608698050 conn(0x7f41b40b1da0 msgr2=0x7f41b40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b670a9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600739f0 0x7f0b600aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b670a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600743b0 0x7f0b60150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b670a9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 0x7f0b6015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b670a9640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6015b660 con 0x7f0b600739f0 2024-09-10T11:38:45.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b670a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6015b4e0 con 0x7f0b600743b0 2024-09-10T11:38:45.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b670a9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6015b7e0 con 0x7f0b600cd2f0 2024-09-10T11:38:45.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 -- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a0074260 msgr2=0x7fa5a020da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a0074260 0x7fa5a020da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 -- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5a015ee00 msgr2=0x7fa5a020c800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T11:38:45.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5a015ee00 0x7fa5a020c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 -- 172.21.15.57:0/608698050 shutdown_connections 2024-09-10T11:38:45.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7fa5a4aff640 1 -- 172.21.15.57:0/3539203225 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a020df90 con 0x7fa5a00b3630 2024-09-10T11:38:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f0b65646640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 0x7f0b6015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b65646640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 0x7f0b6015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:43416/0 (socket says 172.21.15.57:43416) 2024-09-10T11:38:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b65646640 1 -- 172.21.15.57:0/568371038 learned_addr learned my addr 172.21.15.57:0/568371038 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b5ffff640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600743b0 0x7f0b60150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b64e45640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600739f0 0x7f0b600aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f80073dc0 con 0x7f9f800cf340 2024-09-10T11:38:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b64e45640 1 -- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 msgr2=0x7f0b6015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f06f5c30640 1 -- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8050d10 msgr2=0x7f06e817d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f06f5c30640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8050d10 0x7f06e817d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f06f5c30640 1 -- 172.21.15.57:0/2747862749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e8008d70 msgr2=0x7f06e804c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7fa5a4aff640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 0x7fa5a01558c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa59000cbe0 tx=0x7fa59000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b64e45640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 0x7f0b6015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b64e45640 1 -- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600743b0 msgr2=0x7f0b60150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b64e45640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600743b0 0x7f0b60150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b64e45640 1 -- 172.21.15.57:0/568371038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b60151200 con 0x7f0b600739f0 2024-09-10T11:38:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b5ffff640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600743b0 0x7f0b60150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590016020 con 0x7fa5a00b3630 2024-09-10T11:38:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f06f5c30640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e8008d70 0x7f06e804c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f06f5c30640 1 -- 172.21.15.57:0/2747862749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e817dd50 con 0x7f06e8034ba0 2024-09-10T11:38:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f06f6431640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e8008d70 0x7f06e804c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7f0b65646640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 0x7f0b6015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7fec3ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec401e4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec400c68d0 0x7fec401e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec401e6a40 0x7fec400cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3ffff640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fec40072480 con 0x7fec28003a30 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3ffff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec40072300 con 0x7fec401e6a40 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3ffff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fec400cc6f0 con 0x7fec400c68d0 2024-09-10T11:38:45.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f0b64e45640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600739f0 0x7f0b600aeb70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b58032000 tx=0x7f0b58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f9f7c0035f0 con 0x7f9f800cf340 2024-09-10T11:38:45.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a0155e00 con 0x7fa5a00b3630 2024-09-10T11:38:45.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a014fd00 con 0x7fa5a00b3630 2024-09-10T11:38:45.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa59000ae50 con 0x7fa5a00b3630 2024-09-10T11:38:45.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590012680 con 0x7fa5a00b3630 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec401e4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec401e4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46840/0 (socket says 172.21.15.57:46840) 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7fec3effd640 1 -- 172.21.15.57:0/693514733 learned_addr learned my addr 172.21.15.57:0/693514733 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58033050 con 0x7f0b600739f0 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b601f1600 con 0x7f0b600739f0 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b601f1bc0 con 0x7f0b600739f0 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.969+0000 7f41bc408640 1 -- 172.21.15.57:0/608698050 wait complete. 2024-09-10T11:38:45.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f41bc408640 1 Processor -- start 2024-09-10T11:38:45.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.970+0000 7fad11f8a640 1 -- 172.21.15.57:0/1566438356 wait complete. 2024-09-10T11:38:45.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fad11f8a640 1 Processor -- start 2024-09-10T11:38:45.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fad11f8a640 1 -- start start 2024-09-10T11:38:45.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fec3effd640 1 -- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec400c68d0 msgr2=0x7fec401e6500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:45.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fec3effd640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec400c68d0 0x7fec401e6500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fec3effd640 1 -- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec401e6a40 msgr2=0x7fec400cb560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:45.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fec3effd640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec401e6a40 0x7fec400cb560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:45.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7fec3effd640 1 -- 172.21.15.57:0/693514733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec400c6e70 con 0x7fec28003a30 2024-09-10T11:38:45.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7f9f767fc640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f640750f0 0x7f9f640775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f7c096bc0 con 0x7f9f800cf340 2024-09-10T11:38:45.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f06f5c30640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 0x7f06e80e1970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c760 tx=0x7f06e000cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.972+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0017070 con 0x7f06e8034ba0 2024-09-10T11:38:45.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7fec3effd640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec401e4470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec30000c00 tx=0x7fec3003bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:45.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e0005270 con 0x7f06e8034ba0 2024-09-10T11:38:45.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e000a8a0 con 0x7f06e8034ba0 2024-09-10T11:38:45.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e817e030 con 0x7f06e8034ba0 2024-09-10T11:38:45.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.971+0000 7f41bc408640 1 -- start start 2024-09-10T11:38:45.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f41bc408640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 0x7f41b41fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:45.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e80e33e0 con 0x7f06e8034ba0 2024-09-10T11:38:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f41bc408640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41b415aa00 0x7f41b40ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f41ba1a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 0x7f41b41fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa580005290 con 0x7fa5a00b3630 2024-09-10T11:38:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f15c400d040 con 0x7f15d015f7e0 2024-09-10T11:38:46.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f9f85b11640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f640750f0 0x7f9f640775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f41ba1a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 0x7f41b41fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46842/0 (socket says 172.21.15.57:46842) 2024-09-10T11:38:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.973+0000 7f41ba1a4640 1 -- 172.21.15.57:0/405878878 learned_addr learned my addr 172.21.15.57:0/405878878 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f41b99a3640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41b415aa00 0x7f41b40ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad11f8a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 0x7fad04032850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 0x7f41b40cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40b3f20 con 0x7f41b4074350 2024-09-10T11:38:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad10f88640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 0x7fad04032850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad10f88640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 0x7fad04032850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:43420/0 (socket says 172.21.15.57:43420) 2024-09-10T11:38:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad11f8a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad040cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad10f88640 1 -- 172.21.15.57:0/2523095019 learned_addr learned my addr 172.21.15.57:0/2523095019 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0404f5b0 0x7fad04179440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8034f80 con 0x7f06e8034ba0 2024-09-10T11:38:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad04052a50 con 0x7fad04055dd0 2024-09-10T11:38:46.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad040528d0 con 0x7fad0404f5b0 2024-09-10T11:38:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad04052bd0 con 0x7fad04054970 2024-09-10T11:38:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f41ba9a5640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 0x7f41b40cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fad0bfff640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad040cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40b3da0 con 0x7f41b415aa00 2024-09-10T11:38:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f41b40b40a0 con 0x7f41b415ade0 2024-09-10T11:38:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad11789640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0404f5b0 0x7fad04179440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6015bc90 con 0x7f0b600739f0 2024-09-10T11:38:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.974+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa590019020 con 0x7fa5a00b3630 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad10f88640 1 -- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0404f5b0 msgr2=0x7fad04179440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad10f88640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0404f5b0 0x7fad04179440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad10f88640 1 -- 172.21.15.57:0/2523095019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 msgr2=0x7fad040cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad10f88640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad040cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad10f88640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0404fa40 con 0x7fad04054970 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad11789640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0404f5b0 0x7fad04179440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:46.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad0bfff640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad040cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:38:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fa59dffb640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa58c075120 0x7fa58c0775e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fa5a5300640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa58c075120 0x7fa58c0775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad10f88640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 0x7fad04032850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c760 tx=0x7fad0000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7f41ba1a4640 1 -- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 msgr2=0x7f41b40cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7f41ba1a4640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 0x7f41b40cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7f41ba1a4640 1 -- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41b415aa00 msgr2=0x7f41b40ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7f41ba1a4640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41b415aa00 0x7f41b40ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7f41ba1a4640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b41f91f0 con 0x7f41b4074350 2024-09-10T11:38:46.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f06e001a070 con 0x7f06e8034ba0 2024-09-10T11:38:46.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.975+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00017070 con 0x7fad04054970 2024-09-10T11:38:46.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad04032e30 con 0x7fad04054970 2024-09-10T11:38:46.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0404edb0 con 0x7fad04054970 2024-09-10T11:38:46.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad00005270 con 0x7fad04054970 2024-09-10T11:38:46.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7f41ba1a4640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 0x7f41b41fcd30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c450 tx=0x7f41b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000a8a0 con 0x7fad04054970 2024-09-10T11:38:46.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7f9f85b11640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f640750f0 0x7f9f640775b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f70033000 tx=0x7f9f70004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7f06e6ffd640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06d4075170 0x7f06d4077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7fa5a5300640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa58c075120 0x7fa58c0775e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5a008bf80 tx=0x7fa594007e30 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06e00956e0 con 0x7f06e8034ba0 2024-09-10T11:38:46.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.976+0000 7f06f6431640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06d4075170 0x7f06d4077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.977+0000 7f06f6431640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06d4075170 0x7f06d4077630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06ec034000 tx=0x7f06ec00b040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.977+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0404fd10 con 0x7fad04054970 2024-09-10T11:38:46.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fad0001a070 con 0x7fad04054970 2024-09-10T11:38:46.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa59005c850 con 0x7fa5a00b3630 2024-09-10T11:38:46.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b580098d0 con 0x7f0b600739f0 2024-09-10T11:38:46.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0016020 con 0x7f41b4074350 2024-09-10T11:38:46.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30040070 con 0x7fec28003a30 2024-09-10T11:38:46.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec400a9520 con 0x7fec28003a30 2024-09-10T11:38:46.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec400a9ae0 con 0x7fec28003a30 2024-09-10T11:38:46.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b41f94d0 con 0x7f41b4074350 2024-09-10T11:38:46.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b41f9a90 con 0x7f41b4074350 2024-09-10T11:38:46.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7fad097fa640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7facf00750a0 0x7facf0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.978+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f9f7c061090 con 0x7f9f800cf340 2024-09-10T11:38:46.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7fad0bfff640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7facf00750a0 0x7facf0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad000956f0 con 0x7fad04054970 2024-09-10T11:38:46.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.979+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58033050 con 0x7f0b600739f0 2024-09-10T11:38:46.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.980+0000 7fad0bfff640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7facf00750a0 0x7facf0077560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0663d0 tx=0x7fad0c06a5d0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.980+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec400ce920 con 0x7fec28003a30 2024-09-10T11:38:46.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.980+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b40cf930 con 0x7f41b4074350 2024-09-10T11:38:46.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.982+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f06e8034f80 con 0x7f06e8034ba0 2024-09-10T11:38:46.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.983+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec30014d90 con 0x7fec28003a30 2024-09-10T11:38:46.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.983+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30014030 con 0x7fec28003a30 2024-09-10T11:38:46.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.983+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41b0012830 con 0x7f41b4074350 2024-09-10T11:38:46.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.983+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0012c60 con 0x7f41b4074350 2024-09-10T11:38:46.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.985+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fa590020020 con 0x7fa5a00b3630 2024-09-10T11:38:46.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.985+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fad0005f3f0 con 0x7fad04054970 2024-09-10T11:38:46.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.985+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0b58036070 con 0x7f0b600739f0 2024-09-10T11:38:46.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.986+0000 7f0b5d7fa640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b4c075290 0x7f0b4c077750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.986+0000 7f0b5ffff640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b4c075290 0x7f0b4c077750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.987+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f41b0019020 con 0x7f41b4074350 2024-09-10T11:38:46.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.987+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b5807d240 con 0x7f0b600739f0 2024-09-10T11:38:46.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.987+0000 7f41aaffd640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41980750a0 0x7f4198077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.987+0000 7f41b99a3640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41980750a0 0x7f4198077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.988+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fec30010670 con 0x7fec28003a30 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.989+0000 7fec27fff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fec2c0750d0 0x7fec2c077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.989+0000 7fec3e7fc640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fec2c0750d0 0x7fec2c077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.990+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fec3007c2e0 con 0x7fec28003a30 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.990+0000 7f0b5ffff640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b4c075290 0x7f0b4c077750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b600b0550 tx=0x7f0b54009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.990+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f0b58080fd0 con 0x7f0b600739f0 2024-09-10T11:38:46.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.990+0000 7f41b99a3640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41980750a0 0x7f4198077560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f41a4034000 tx=0x7f41a4004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.990+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41b005c440 con 0x7f41b4074350 2024-09-10T11:38:46.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.990+0000 7fec3e7fc640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fec2c0750d0 0x7fec2c077590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec401eaae0 tx=0x7fec38007d30 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:46.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:45.995+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fec400ce920 con 0x7fec28003a30 2024-09-10T11:38:46.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.002+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f41b40cf930 con 0x7f41b4074350 2024-09-10T11:38:46.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.346+0000 7f15d4ad4640 1 -- 172.21.15.57:0/2706380350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f15d00c9f70 con 0x7f15d015f7e0 2024-09-10T11:38:46.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.347+0000 7f15beffd640 1 -- 172.21.15.57:0/2706380350 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f15c405fe50 con 0x7f15d015f7e0 2024-09-10T11:38:46.347 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2024-09-10T11:38:46.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 -- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15b00750a0 msgr2=0x7f15b0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15b00750a0 0x7f15b0077560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15d00d2640 tx=0x7f15c00090e0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 -- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 msgr2=0x7f15d00c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 0x7f15d00c79e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b450 tx=0x7f15c400b910 comp rx=0 tx=0).stop 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 -- 172.21.15.57:0/2706380350 shutdown_connections 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15b00750a0 0x7f15b0077560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d015fc50 0x7f15d00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.350+0000 7f15bcff9640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15d015f7e0 0x7f15d00c79e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.351+0000 7f15bcff9640 1 --2- 172.21.15.57:0/2706380350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15d00d1a70 0x7f15d00c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.351+0000 7f15bcff9640 1 -- 172.21.15.57:0/2706380350 >> 172.21.15.57:0/2706380350 conn(0x7f15d009aa20 msgr2=0x7f15d00ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.351+0000 7f15bcff9640 1 -- 172.21.15.57:0/2706380350 shutdown_connections 2024-09-10T11:38:46.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.351+0000 7f15bcff9640 1 -- 172.21.15.57:0/2706380350 wait complete. 2024-09-10T11:38:46.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.357+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9f800b2b70 con 0x7f9f800cf340 2024-09-10T11:38:46.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.357+0000 7f9f767fc640 1 -- 172.21.15.57:0/3535439927 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f7c060990 con 0x7f9f800cf340 2024-09-10T11:38:46.358 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2024-09-10T11:38:46.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.358+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa580005580 con 0x7fa5a00b3630 2024-09-10T11:38:46.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.359+0000 7fa59dffb640 1 -- 172.21.15.57:0/3539203225 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5a020df90 con 0x7fa5a00b3630 2024-09-10T11:38:46.360 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2024-09-10T11:38:46.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.360+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f06e8009a30 con 0x7f06e8034ba0 2024-09-10T11:38:46.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.360+0000 7f06e6ffd640 1 -- 172.21.15.57:0/2747862749 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06e005f490 con 0x7f06e8034ba0 2024-09-10T11:38:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.360+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f640750f0 msgr2=0x7f9f640775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.360+0000 7f9f87d75640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f640750f0 0x7f9f640775b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f70033000 tx=0x7f9f70004730 comp rx=0 tx=0).stop 2024-09-10T11:38:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 msgr2=0x7f9f80151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 0x7f9f80151ff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c00ee80 comp rx=0 tx=0).stop 2024-09-10T11:38:46.362 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:46.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 shutdown_connections 2024-09-10T11:38:46.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f640750f0 0x7f9f640775b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f8015a870 0x7f9f800c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f800cf340 0x7f9f80151ff0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c00ee80 comp rx=0 tx=0).stop 2024-09-10T11:38:46.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 --2- 172.21.15.57:0/3535439927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f80070af0 0x7f9f800c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 >> 172.21.15.57:0/3535439927 conn(0x7f9f800b2540 msgr2=0x7f9f800d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 shutdown_connections 2024-09-10T11:38:46.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.361+0000 7f9f87d75640 1 -- 172.21.15.57:0/3535439927 wait complete. 2024-09-10T11:38:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa58c075120 msgr2=0x7fa58c0775e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa58c075120 0x7fa58c0775e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5a008bf80 tx=0x7fa594007e30 comp rx=0 tx=0).stop 2024-09-10T11:38:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 msgr2=0x7fa5a01558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 0x7fa5a01558c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa59000cbe0 tx=0x7fa59000a430 comp rx=0 tx=0).stop 2024-09-10T11:38:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 shutdown_connections 2024-09-10T11:38:46.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa58c075120 0x7fa58c0775e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5a015ee00 0x7fa5a020c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5a00b3630 0x7fa5a01558c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.363+0000 7fa5a7564640 1 --2- 172.21.15.57:0/3539203225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5a0074260 0x7fa5a020da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 >> 172.21.15.57:0/3539203225 conn(0x7fa5a006d1e0 msgr2=0x7fa5a0161f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 shutdown_connections 2024-09-10T11:38:46.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7fa5a7564640 1 -- 172.21.15.57:0/3539203225 wait complete. 2024-09-10T11:38:46.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06d4075170 msgr2=0x7f06d4077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7f06f8695640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06d4075170 0x7f06d4077630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f06ec034000 tx=0x7f06ec00b040 comp rx=0 tx=0).stop 2024-09-10T11:38:46.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 msgr2=0x7f06e80e1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7f06f8695640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 0x7f06e80e1970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c760 tx=0x7f06e000cc20 comp rx=0 tx=0).stop 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 shutdown_connections 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.364+0000 7f06f8695640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06d4075170 0x7f06d4077630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7f06f8695640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06e8050d10 0x7f06e817d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7f06f8695640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06e8034ba0 0x7f06e80e1970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7f06f8695640 1 --2- 172.21.15.57:0/2747862749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06e8008d70 0x7f06e804c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 >> 172.21.15.57:0/2747862749 conn(0x7f06e801e890 msgr2=0x7f06e80520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 shutdown_connections 2024-09-10T11:38:46.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7f06f8695640 1 -- 172.21.15.57:0/2747862749 wait complete. 2024-09-10T11:38:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.365+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fad04052300 con 0x7fad04054970 2024-09-10T11:38:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.366+0000 7fad097fa640 1 -- 172.21.15.57:0/2523095019 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad00063bb0 con 0x7fad04054970 2024-09-10T11:38:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.366+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0b600d0d00 con 0x7f0b600739f0 2024-09-10T11:38:46.370 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2024-09-10T11:38:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.367+0000 7f0b5d7fa640 1 -- 172.21.15.57:0/568371038 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b58085790 con 0x7f0b600739f0 2024-09-10T11:38:46.370 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2024-09-10T11:38:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.368+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fec400cf020 con 0x7fec28003a30 2024-09-10T11:38:46.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2024-09-10T11:38:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.368+0000 7fec27fff640 1 -- 172.21.15.57:0/693514733 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec30049060 con 0x7fec28003a30 2024-09-10T11:38:46.372 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2024-09-10T11:38:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7facf00750a0 msgr2=0x7facf0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7facf00750a0 0x7facf0077560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0663d0 tx=0x7fad0c06a5d0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 msgr2=0x7fad04032850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 0x7fad04032850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c760 tx=0x7fad0000cc20 comp rx=0 tx=0).stop 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 shutdown_connections 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7facf00750a0 0x7facf0077560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0404f5b0 0x7fad04179440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad04055dd0 0x7fad040cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 --2- 172.21.15.57:0/2523095019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad04054970 0x7fad04032850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 >> 172.21.15.57:0/2523095019 conn(0x7fad0401e8d0 msgr2=0x7fad04037930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 shutdown_connections 2024-09-10T11:38:46.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.369+0000 7fad11f8a640 1 -- 172.21.15.57:0/2523095019 wait complete. 2024-09-10T11:38:46.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.370+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b4c075290 msgr2=0x7f0b4c077750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.370+0000 7f0b670a9640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b4c075290 0x7f0b4c077750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b600b0550 tx=0x7f0b54009040 comp rx=0 tx=0).stop 2024-09-10T11:38:46.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.370+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600739f0 msgr2=0x7f0b600aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.370+0000 7f0b670a9640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600739f0 0x7f0b600aeb70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b58032000 tx=0x7f0b58004270 comp rx=0 tx=0).stop 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 shutdown_connections 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0b4c075290 0x7f0b4c077750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600cd2f0 0x7f0b6015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b600743b0 0x7f0b60150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 --2- 172.21.15.57:0/568371038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600739f0 0x7f0b600aeb70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 >> 172.21.15.57:0/568371038 conn(0x7f0b600b2690 msgr2=0x7f0b600cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 shutdown_connections 2024-09-10T11:38:46.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.371+0000 7f0b670a9640 1 -- 172.21.15.57:0/568371038 wait complete. 2024-09-10T11:38:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.372+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fec2c0750d0 msgr2=0x7fec2c077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.372+0000 7fec3ffff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fec2c0750d0 0x7fec2c077590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec401eaae0 tx=0x7fec38007d30 comp rx=0 tx=0).stop 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 msgr2=0x7fec401e4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec401e4470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec30000c00 tx=0x7fec3003bc10 comp rx=0 tx=0).stop 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 shutdown_connections 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fec2c0750d0 0x7fec2c077590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec401e6a40 0x7fec400cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec400c68d0 0x7fec401e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 --2- 172.21.15.57:0/693514733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec28003a30 0x7fec401e4470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 >> 172.21.15.57:0/693514733 conn(0x7fec400b1430 msgr2=0x7fec400c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.373+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 shutdown_connections 2024-09-10T11:38:46.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.375+0000 7fec3ffff640 1 -- 172.21.15.57:0/693514733 wait complete. 2024-09-10T11:38:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.375+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f41b40b4530 con 0x7f41b4074350 2024-09-10T11:38:46.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.376+0000 7f41aaffd640 1 -- 172.21.15.57:0/405878878 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41b0020070 con 0x7f41b4074350 2024-09-10T11:38:46.378 INFO:teuthology.orchestra.run.smithi057.stdout:55834574852 2024-09-10T11:38:46.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.379+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41980750a0 msgr2=0x7f4198077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.379+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41980750a0 0x7f4198077560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f41a4034000 tx=0x7f41a4004730 comp rx=0 tx=0).stop 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.379+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 msgr2=0x7f41b41fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.379+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 0x7f41b41fcd30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41b000c450 tx=0x7f41b000c910 comp rx=0 tx=0).stop 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 shutdown_connections 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41980750a0 0x7f4198077560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41b415ade0 0x7f41b40cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41b415aa00 0x7f41b40ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 --2- 172.21.15.57:0/405878878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41b4074350 0x7f41b41fcd30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 >> 172.21.15.57:0/405878878 conn(0x7f41b40b1da0 msgr2=0x7f41b415c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 shutdown_connections 2024-09-10T11:38:46.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:46.380+0000 7f41bc408640 1 -- 172.21.15.57:0/405878878 wait complete. 2024-09-10T11:38:46.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2024-09-10T11:38:46.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2024-09-10T11:38:46.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2024-09-10T11:38:46.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2024-09-10T11:38:46.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2024-09-10T11:38:46.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-09-10T11:38:46.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-09-10T11:38:47.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T11:38:47.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T11:38:47.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T11:38:47.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T11:38:47.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T11:38:47.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T11:38:47.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T11:38:47.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.552+0000 7f08147e2640 1 -- 172.21.15.57:0/3865683998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c15dbe0 msgr2=0x7f080c0b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.552+0000 7f08147e2640 1 --2- 172.21.15.57:0/3865683998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c15dbe0 0x7f080c0b2db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f080c072650 tx=0x7f080802a440 comp rx=0 tx=0).stop 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 -- 172.21.15.57:0/3865683998 shutdown_connections 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 --2- 172.21.15.57:0/3865683998 >> v2:172.21.15.154:3300/0 conn(0x7f080c0b3a40 0x7f080c161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 --2- 172.21.15.57:0/3865683998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f080c06e870 0x7f080c0b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 --2- 172.21.15.57:0/3865683998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c15dbe0 0x7f080c0b2db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 -- 172.21.15.57:0/3865683998 >> 172.21.15.57:0/3865683998 conn(0x7f080c0b16f0 msgr2=0x7f080c0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 -- 172.21.15.57:0/3865683998 shutdown_connections 2024-09-10T11:38:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.553+0000 7f08147e2640 1 -- 172.21.15.57:0/3865683998 wait complete. 2024-09-10T11:38:47.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.555+0000 7f08147e2640 1 Processor -- start 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.556+0000 7f08147e2640 1 -- start start 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.557+0000 7f08147e2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 0x7f080c1f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.557+0000 7f08147e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f080c0b3a40 0x7f080c0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.557+0000 7f08147e2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f080c15dbe0 0x7f080c0b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.557+0000 7f08147e2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f080c161db0 con 0x7f080c06e870 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.557+0000 7f08147e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f080c06eec0 con 0x7f080c0b3a40 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.557+0000 7f08147e2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f080c161f30 con 0x7f080c15dbe0 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.558+0000 7f081257e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 0x7f080c1f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.558+0000 7f081257e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 0x7f080c1f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46862/0 (socket says 172.21.15.57:46862) 2024-09-10T11:38:47.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.558+0000 7f081257e640 1 -- 172.21.15.57:0/2859118772 learned_addr learned my addr 172.21.15.57:0/2859118772 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.559+0000 7f081257e640 1 -- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f080c15dbe0 msgr2=0x7f080c0b0af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.559+0000 7f081257e640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f080c15dbe0 0x7f080c0b0af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.559+0000 7f081257e640 1 -- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f080c0b3a40 msgr2=0x7f080c0b05b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.559+0000 7f081257e640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f080c0b3a40 0x7f080c0b05b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.559+0000 7f081257e640 1 -- 172.21.15.57:0/2859118772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080c1fa0d0 con 0x7f080c06e870 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.559+0000 7f081257e640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 0x7f080c1f9b90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0808009850 tx=0x7f0808003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.560+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080803f070 con 0x7f080c06e870 2024-09-10T11:38:47.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.560+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080c14da70 con 0x7f080c06e870 2024-09-10T11:38:47.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.560+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080c14e030 con 0x7f080c06e870 2024-09-10T11:38:47.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.563+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0808003d00 con 0x7f080c06e870 2024-09-10T11:38:47.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.563+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808035030 con 0x7f080c06e870 2024-09-10T11:38:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.564+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0808042070 con 0x7f080c06e870 2024-09-10T11:38:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.565+0000 7f0802ffd640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07f0075170 0x7f07f0077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.565+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f08080b7290 con 0x7f080c06e870 2024-09-10T11:38:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.565+0000 7f0811d7d640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07f0075170 0x7f07f0077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.566+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f4005290 con 0x7f080c06e870 2024-09-10T11:38:47.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.574+0000 7f0811d7d640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07f0075170 0x7f07f0077630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f080c0693a0 tx=0x7f0804009250 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.575+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f080c1fa0d0 con 0x7f080c06e870 2024-09-10T11:38:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 -- 172.21.15.57:0/3672932837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 msgr2=0x7f1028054ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 --2- 172.21.15.57:0/3672932837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028054ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f103002e900 tx=0x7f10300a5b10 comp rx=0 tx=0).stop 2024-09-10T11:38:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 -- 172.21.15.57:0/3672932837 shutdown_connections 2024-09-10T11:38:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 --2- 172.21.15.57:0/3672932837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028054ca0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 --2- 172.21.15.57:0/3672932837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 0x7f1028054760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 -- 172.21.15.57:0/3672932837 >> 172.21.15.57:0/3672932837 conn(0x7f102801e890 msgr2=0x7f1028055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 -- 172.21.15.57:0/3672932837 shutdown_connections 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f103556b640 1 -- 172.21.15.57:0/3672932837 wait complete. 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f24ad72b640 1 -- 172.21.15.57:0/2565168461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a0005a90 msgr2=0x7f24a001cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.605+0000 7f24ad72b640 1 --2- 172.21.15.57:0/2565168461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a0005a90 0x7f24a001cfd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f24a806c790 tx=0x7f24a80a59e0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f24ad72b640 1 -- 172.21.15.57:0/2565168461 shutdown_connections 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f24ad72b640 1 --2- 172.21.15.57:0/2565168461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a0009a80 0x7f24a0009f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f24ad72b640 1 --2- 172.21.15.57:0/2565168461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a0005a90 0x7f24a001cfd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f24ad72b640 1 -- 172.21.15.57:0/2565168461 >> 172.21.15.57:0/2565168461 conn(0x7f24a0054590 msgr2=0x7f24a0054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 -- 172.21.15.57:0/4168943351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f165c003a50 msgr2=0x7f165c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 --2- 172.21.15.57:0/4168943351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f165c003a50 0x7f165c003e70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f166400c2e0 tx=0x7f165c005830 comp rx=0 tx=0).stop 2024-09-10T11:38:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 -- 172.21.15.57:0/4168943351 shutdown_connections 2024-09-10T11:38:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 --2- 172.21.15.57:0/4168943351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f165c003a50 0x7f165c003e70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 -- 172.21.15.57:0/4168943351 >> 172.21.15.57:0/4168943351 conn(0x7f167406d1e0 msgr2=0x7f16740b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 -- 172.21.15.57:0/4168943351 shutdown_connections 2024-09-10T11:38:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f3ccca33640 1 -- 172.21.15.57:0/1521312404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0008d80 msgr2=0x7f3cc0054750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1521312404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0008d80 0x7f3cc0054750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009850 tx=0x7f3cbc02a460 comp rx=0 tx=0).stop 2024-09-10T11:38:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f103556b640 1 Processor -- start 2024-09-10T11:38:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f103556b640 1 -- start start 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 -- 172.21.15.57:0/1096378423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a80d45e0 msgr2=0x7f64a80b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/1096378423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a80d45e0 0x7f64a80b7690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f64a808cfa0 tx=0x7f64a002ab50 comp rx=0 tx=0).stop 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 -- 172.21.15.57:0/1096378423 shutdown_connections 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/1096378423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a80d45e0 0x7f64a80b7690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/1096378423 >> v2:172.21.15.57:3300/0 conn(0x7f64a80d0ce0 0x7f64a80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 -- 172.21.15.57:0/1096378423 >> 172.21.15.57:0/1096378423 conn(0x7f64a809ce70 msgr2=0x7f64a80d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 -- 172.21.15.57:0/1096378423 shutdown_connections 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.607+0000 7f64ad4e2640 1 -- 172.21.15.57:0/1096378423 wait complete. 2024-09-10T11:38:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f24ad72b640 1 -- 172.21.15.57:0/2565168461 shutdown_connections 2024-09-10T11:38:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f24ad72b640 1 -- 172.21.15.57:0/2565168461 wait complete. 2024-09-10T11:38:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.606+0000 7f167a608640 1 -- 172.21.15.57:0/4168943351 wait complete. 2024-09-10T11:38:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.608+0000 7f167a608640 1 Processor -- start 2024-09-10T11:38:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.608+0000 7f24ad72b640 1 Processor -- start 2024-09-10T11:38:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.608+0000 7f24ad72b640 1 -- start start 2024-09-10T11:38:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f167a608640 1 -- start start 2024-09-10T11:38:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.608+0000 7f3ccca33640 1 -- 172.21.15.57:0/1521312404 shutdown_connections 2024-09-10T11:38:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.608+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1521312404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0008d80 0x7f3cc0054750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.608+0000 7f3ccca33640 1 -- 172.21.15.57:0/1521312404 >> 172.21.15.57:0/1521312404 conn(0x7f3cc001e880 msgr2=0x7f3cc0055630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f64ad4e2640 1 Processor -- start 2024-09-10T11:38:47.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f103556b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 0x7f10280e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f103556b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1028034ba0 0x7f10280078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f64ad4e2640 1 -- start start 2024-09-10T11:38:47.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f3ccca33640 1 -- 172.21.15.57:0/1521312404 shutdown_connections 2024-09-10T11:38:47.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f3ccca33640 1 -- 172.21.15.57:0/1521312404 wait complete. 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f102ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 0x7f10280e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f102ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 0x7f10280e56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:43500/0 (socket says 172.21.15.57:43500) 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.609+0000 7f102ffff640 1 -- 172.21.15.57:0/4098454565 learned_addr learned my addr 172.21.15.57:0/4098454565 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f103556b640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028007e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f102f7fe640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1028034ba0 0x7f10280078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24ad72b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a0005a90 0x7f24a0189fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24ad72b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a0009a80 0x7f24a01870d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24ad72b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 0x7f24a00df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24ad72b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f24a000a9f0 con 0x7f24a000ba30 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f7885223640 1 -- 172.21.15.57:0/2147774624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800b3630 msgr2=0x7f78800b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f7885223640 1 --2- 172.21.15.57:0/2147774624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800b3630 0x7f78800b3a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7874005fd0 tx=0x7f787402a5f0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f167a608640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165c003a50 0x7f167415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f167a608640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 0x7f16741faf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f167a608640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741fb460 0x7f16742048c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f167a608640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f16740728e0 con 0x7f167415b4d0 2024-09-10T11:38:47.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f167a608640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16740b3fc0 con 0x7f16741fb460 2024-09-10T11:38:47.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f167a608640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1674072a60 con 0x7f165c003a50 2024-09-10T11:38:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24ad72b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24a000a870 con 0x7f24a0005a90 2024-09-10T11:38:47.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24ad72b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f24a000ab70 con 0x7f24a0009a80 2024-09-10T11:38:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f16737fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 0x7f16741faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24a77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 0x7f24a00df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24a77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 0x7f24a00df3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46924/0 (socket says 172.21.15.57:46924) 2024-09-10T11:38:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f24a77fe640 1 -- 172.21.15.57:0/3002743208 learned_addr learned my addr 172.21.15.57:0/3002743208 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f103556b640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f10280347d0 con 0x7f1028050d10 2024-09-10T11:38:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f103556b640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1028034650 con 0x7f1028034ba0 2024-09-10T11:38:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f103556b640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1028034950 con 0x7f1028008d90 2024-09-10T11:38:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f1034d6a640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028007e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f16737fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 0x7f16741faf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46920/0 (socket says 172.21.15.57:46920) 2024-09-10T11:38:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f16737fe640 1 -- 172.21.15.57:0/1456811111 learned_addr learned my addr 172.21.15.57:0/1456811111 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a6ffd640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a0005a90 0x7f24a0189fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f64ad4e2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64a80d0ce0 0x7f64a81f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a67fc640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a0009a80 0x7f24a01870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1673fff640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165c003a50 0x7f167415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1678ba5640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741fb460 0x7f16742048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.610+0000 7f11d7fff640 1 -- 172.21.15.57:0/918764176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0031bf0 con 0x7f11e00707a0 2024-09-10T11:38:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f64ad4e2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64a80d45e0 0x7f64a80c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a77fe640 1 -- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a0009a80 msgr2=0x7f24a01870d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1034d6a640 1 -- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 msgr2=0x7f10280e56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1034d6a640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 0x7f10280e56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1034d6a640 1 -- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1028034ba0 msgr2=0x7f10280078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a77fe640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a0009a80 0x7f24a01870d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a77fe640 1 -- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a0005a90 msgr2=0x7f24a0189fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a77fe640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a0005a90 0x7f24a0189fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f24a77fe640 1 -- 172.21.15.57:0/3002743208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a018a690 con 0x7f24a000ba30 2024-09-10T11:38:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1034d6a640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1028034ba0 0x7f10280078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1034d6a640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10280e5c10 con 0x7f1028050d10 2024-09-10T11:38:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f3ccca33640 1 Processor -- start 2024-09-10T11:38:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f16737fe640 1 -- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165c003a50 msgr2=0x7f167415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f16737fe640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165c003a50 0x7f167415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f16737fe640 1 -- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741fb460 msgr2=0x7f16742048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f16737fe640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741fb460 0x7f16742048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f16737fe640 1 -- 172.21.15.57:0/1456811111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1674153440 con 0x7f167415b4d0 2024-09-10T11:38:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f11e73da640 1 -- 172.21.15.57:0/918764176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 msgr2=0x7f11e00ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f11e73da640 1 --2- 172.21.15.57:0/918764176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 0x7f11e00ce210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009830 tx=0x7f11d002a510 comp rx=0 tx=0).stop 2024-09-10T11:38:47.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f1034d6a640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028007e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f103006b4b0 tx=0x7f10300a89e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f3ccca33640 1 -- start start 2024-09-10T11:38:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f11e73da640 1 -- 172.21.15.57:0/918764176 shutdown_connections 2024-09-10T11:38:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f11e73da640 1 --2- 172.21.15.57:0/918764176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 0x7f11e00ce210 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f11e73da640 1 --2- 172.21.15.57:0/918764176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e006a6d0 0x7f11e0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f11e73da640 1 -- 172.21.15.57:0/918764176 >> 172.21.15.57:0/918764176 conn(0x7f11e00cfd10 msgr2=0x7f11e00d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f7885223640 1 -- 172.21.15.57:0/2147774624 shutdown_connections 2024-09-10T11:38:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f7885223640 1 --2- 172.21.15.57:0/2147774624 >> v2:172.21.15.154:3300/0 conn(0x7f78800ad890 0x7f78800add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f7885223640 1 --2- 172.21.15.57:0/2147774624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800b3630 0x7f78800b3a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.611+0000 7f7885223640 1 -- 172.21.15.57:0/2147774624 >> 172.21.15.57:0/2147774624 conn(0x7f788006d1e0 msgr2=0x7f78800b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f24a77fe640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 0x7f24a00df3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2498009fd0 tx=0x7f249800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f7885223640 1 -- 172.21.15.57:0/2147774624 shutdown_connections 2024-09-10T11:38:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f16737fe640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 0x7f16741faf20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1668004e80 tx=0x7f1668001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64ad4e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 0x7f64a81f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10300a8e60 con 0x7f1028050d10 2024-09-10T11:38:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668015020 con 0x7f167415b4d0 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1668011980 con 0x7f167415b4d0 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f167a608640 1 -- 172.21.15.57:0/1456811111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1674153720 con 0x7f167415b4d0 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f167a608640 1 -- 172.21.15.57:0/1456811111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1674153ce0 con 0x7f167415b4d0 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668011dd0 con 0x7f167415b4d0 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f3ccca33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc0008d80 0x7f3cc004c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f3ccca33640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc0034b90 0x7f3cc0179eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f3ccca33640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0050d00 0x7f3cc00d99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f3ccca33640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc00347c0 con 0x7f3cc0034b90 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f3ccca33640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc0034640 con 0x7f3cc0008d80 2024-09-10T11:38:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f3ccca33640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc0034940 con 0x7f3cc0050d00 2024-09-10T11:38:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f103556b640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10280e5ee0 con 0x7f1028050d10 2024-09-10T11:38:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f103556b640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1028179c20 con 0x7f1028050d10 2024-09-10T11:38:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10300b7070 con 0x7f1028050d10 2024-09-10T11:38:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10300ba620 con 0x7f1028050d10 2024-09-10T11:38:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f7885223640 1 -- 172.21.15.57:0/2147774624 wait complete. 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64ad4e2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80b8200 con 0x7f64a80d45e0 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64ad4e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80b8080 con 0x7f64a815ded0 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 0x7f64a81f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 0x7f64a81f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:56000/0 (socket says 172.21.15.57:56000) 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 -- 172.21.15.57:0/2629631522 learned_addr learned my addr 172.21.15.57:0/2629631522 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f64a80b8380 con 0x7f64a80d0ce0 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64a7fff640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64a80d0ce0 0x7f64a81f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 -- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64a80d0ce0 msgr2=0x7f64a81f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64a80d0ce0 0x7f64a81f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 -- 172.21.15.57:0/2629631522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64a80d45e0 msgr2=0x7f64a80c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64a80d45e0 0x7f64a80c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.612+0000 7f64acce1640 1 -- 172.21.15.57:0/2629631522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a80d1980 con 0x7f64a815ded0 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f64acce1640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 0x7f64a81f5900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009d60 tx=0x7f64a002c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0004450 con 0x7f64a815ded0 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64a0043070 con 0x7f64a815ded0 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a80c8e20 con 0x7f64a815ded0 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f11e73da640 1 -- 172.21.15.57:0/918764176 shutdown_connections 2024-09-10T11:38:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc0008d80 0x7f3cc004c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a80c93e0 con 0x7f64a815ded0 2024-09-10T11:38:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f3cc77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc0008d80 0x7f3cc004c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:56002/0 (socket says 172.21.15.57:56002) 2024-09-10T11:38:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f3cc77fe640 1 -- 172.21.15.57:0/1920888271 learned_addr learned my addr 172.21.15.57:0/1920888271 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f3cc6ffd640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc0034b90 0x7f3cc0179eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a002d480 con 0x7f64a815ded0 2024-09-10T11:38:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498011830 con 0x7f24a000ba30 2024-09-10T11:38:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f7885223640 1 Processor -- start 2024-09-10T11:38:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a018a970 con 0x7f24a000ba30 2024-09-10T11:38:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a0186bb0 con 0x7f24a000ba30 2024-09-10T11:38:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f7885223640 1 -- start start 2024-09-10T11:38:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1674161820 con 0x7f167415b4d0 2024-09-10T11:38:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.614+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2498016070 con 0x7f24a000ba30 2024-09-10T11:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.613+0000 7f11e73da640 1 -- 172.21.15.57:0/918764176 wait complete. 2024-09-10T11:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f11e73da640 1 Processor -- start 2024-09-10T11:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498011d40 con 0x7f24a000ba30 2024-09-10T11:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f11e73da640 1 -- start start 2024-09-10T11:38:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.616+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f1668018020 con 0x7f167415b4d0 2024-09-10T11:38:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f3cc6ffd640 1 -- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0050d00 msgr2=0x7f3cc00d99e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T11:38:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f1670ff9640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1660075120 0x7f16600775e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e73da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 0x7f11e0201370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1668096a30 con 0x7f167415b4d0 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e73da640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 0x7f11e009ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e73da640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00726a0 0x7f11e01f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e73da640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0072b50 con 0x7f11e00707a0 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e73da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11e006fea0 con 0x7f11e006a6d0 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e73da640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f11e0072cd0 con 0x7f11e00726a0 2024-09-10T11:38:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e5176640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 0x7f11e0201370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f1673fff640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1660075120 0x7f16600775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e5977640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00726a0 0x7f11e01f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e5176640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 0x7f11e0201370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:56014/0 (socket says 172.21.15.57:56014) 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e5176640 1 -- 172.21.15.57:0/3589907605 learned_addr learned my addr 172.21.15.57:0/3589907605 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f3cc6ffd640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0050d00 0x7f3cc00d99e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f3cc6ffd640 1 -- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc0008d80 msgr2=0x7f3cc004c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f3cc6ffd640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc0008d80 0x7f3cc004c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f3cc6ffd640 1 -- 172.21.15.57:0/1920888271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc004ccc0 con 0x7f3cc0034b90 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.615+0000 7f3cc6ffd640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc0034b90 0x7f3cc0179eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c390 tx=0x7f3cb400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.616+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4017070 con 0x7f3cc0034b90 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.616+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb40053c0 con 0x7f3cc0034b90 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.616+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4003850 con 0x7f3cc0034b90 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f11e4975640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 0x7f11e009ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1010005290 con 0x7f1028050d10 2024-09-10T11:38:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6488005290 con 0x7f64a815ded0 2024-09-10T11:38:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f64a0048460 con 0x7f64a815ded0 2024-09-10T11:38:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc004cfa0 con 0x7f3cc0034b90 2024-09-10T11:38:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f7885223640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800ad890 0x7f7880151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc004d560 con 0x7f3cc0034b90 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f7885223640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78800b3630 0x7f7880143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f7885223640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78801582f0 0x7f7880160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f7885223640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f78800ae3c0 con 0x7f78800b3630 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f7885223640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78800ae240 con 0x7f78800ad890 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f7885223640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f78800ae540 con 0x7f78801582f0 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f64a4ff9640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6494075170 0x7f6494077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f64a00b75e0 con 0x7f64a815ded0 2024-09-10T11:38:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f11e5176640 1 -- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00726a0 msgr2=0x7f11e01f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f11e5176640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00726a0 0x7f11e01f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f11e5176640 1 -- 172.21.15.57:0/3589907605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 msgr2=0x7f11e009ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f787e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78800b3630 0x7f7880143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f787e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78800b3630 0x7f7880143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46960/0 (socket says 172.21.15.57:46960) 2024-09-10T11:38:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f787e59c640 1 -- 172.21.15.57:0/3179562334 learned_addr learned my addr 172.21.15.57:0/3179562334 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f787ed9d640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800ad890 0x7f7880151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f10300b9070 con 0x7f1028050d10 2024-09-10T11:38:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f11e5176640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 0x7f11e009ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f1673fff640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1660075120 0x7f16600775e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1664001eb0 tx=0x7f16640019f0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f11e5176640 1 -- 172.21.15.57:0/3589907605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e02018b0 con 0x7f11e006a6d0 2024-09-10T11:38:47.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f64a7fff640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6494075170 0x7f6494077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.618+0000 7f11e5176640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 0x7f11e0201370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00d950 tx=0x7f11dc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.617+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2488005290 con 0x7f24a000ba30 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787f59e640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78801582f0 0x7f7880160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787ed9d640 1 -- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78801582f0 msgr2=0x7f7880160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787ed9d640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78801582f0 0x7f7880160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787ed9d640 1 -- 172.21.15.57:0/3179562334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78800b3630 msgr2=0x7f7880143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787ed9d640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78800b3630 0x7f7880143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787ed9d640 1 -- 172.21.15.57:0/3179562334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78801510e0 con 0x7f78800ad890 2024-09-10T11:38:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f249801b460 con 0x7f24a000ba30 2024-09-10T11:38:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f787ed9d640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800ad890 0x7f7880151e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f787000c340 tx=0x7f787000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc004c3b0 con 0x7f3cc0034b90 2024-09-10T11:38:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f102cff9640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1014075170 0x7f1014077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1030131820 con 0x7f1028050d10 2024-09-10T11:38:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f102ffff640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1014075170 0x7f1014077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f248f7fe640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f24940751a0 0x7f2494077660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.619+0000 7f64a7fff640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6494075170 0x7f6494077630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6498000f60 tx=0x7f6498009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.620+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2498095ff0 con 0x7f24a000ba30 2024-09-10T11:38:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.620+0000 7f24a6ffd640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f24940751a0 0x7f2494077660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.620+0000 7f102ffff640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1014075170 0x7f1014077630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f101c005fd0 tx=0x7f101c00a580 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.620+0000 7f24a6ffd640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f24940751a0 0x7f2494077660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24a0189f10 tx=0x7f249c0013c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.622+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f166801f030 con 0x7f167415b4d0 2024-09-10T11:38:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.622+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870017070 con 0x7f78800ad890 2024-09-10T11:38:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.622+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc017070 con 0x7f11e006a6d0 2024-09-10T11:38:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11dc009d20 con 0x7f11e006a6d0 2024-09-10T11:38:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0106c0 con 0x7f11e006a6d0 2024-09-10T11:38:47.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.622+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78700053c0 con 0x7f78800ad890 2024-09-10T11:38:47.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78801f9050 con 0x7f78800ad890 2024-09-10T11:38:47.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700118b0 con 0x7f78800ad890 2024-09-10T11:38:47.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f64a80d1980 con 0x7f64a815ded0 2024-09-10T11:38:47.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7880151640 con 0x7f78800ad890 2024-09-10T11:38:47.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.623+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e00b4100 con 0x7f11e006a6d0 2024-09-10T11:38:47.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.624+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e00b46c0 con 0x7f11e006a6d0 2024-09-10T11:38:47.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.625+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f787001a070 con 0x7f78800ad890 2024-09-10T11:38:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.625+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78800ae9f0 con 0x7f78800ad890 2024-09-10T11:38:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.625+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e0159b90 con 0x7f11e006a6d0 2024-09-10T11:38:47.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.626+0000 7f78677fe640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f786c0750a0 0x7f786c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.626+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7870095700 con 0x7f78800ad890 2024-09-10T11:38:47.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.626+0000 7f787e59c640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f786c0750a0 0x7f786c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.626+0000 7f787e59c640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f786c0750a0 0x7f786c077560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f7874004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.627+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f11dc004020 con 0x7f11e006a6d0 2024-09-10T11:38:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.627+0000 7f11d5ffb640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f11c4075170 0x7f11c4077630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.627+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f11dc096060 con 0x7f11e006a6d0 2024-09-10T11:38:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.627+0000 7f11e4975640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f11c4075170 0x7f11c4077630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.628+0000 7f11e4975640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f11c4075170 0x7f11c4077630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11d0034000 tx=0x7f11d0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.629+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f10300bf060 con 0x7f1028050d10 2024-09-10T11:38:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.630+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f78801510e0 con 0x7f78800ad890 2024-09-10T11:38:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.634+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f11e02018b0 con 0x7f11e006a6d0 2024-09-10T11:38:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.637+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2498060330 con 0x7f24a000ba30 2024-09-10T11:38:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.638+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f3cb401a070 con 0x7f3cc0034b90 2024-09-10T11:38:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.650+0000 7f3cb3fff640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3cac0750f0 0x7f3cac0775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.651+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3cb4095a50 con 0x7f3cc0034b90 2024-09-10T11:38:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.651+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f3cb4022020 con 0x7f3cc0034b90 2024-09-10T11:38:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.652+0000 7f3cc77fe640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3cac0750f0 0x7f3cac0775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:47.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.665+0000 7f3cc77fe640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3cac0750f0 0x7f3cac0775b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009590 tx=0x7f3cbc02bf90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:47.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.943+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f07f4005580 con 0x7f080c06e870 2024-09-10T11:38:47.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.944+0000 7f0802ffd640 1 -- 172.21.15.57:0/2859118772 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08080815d0 con 0x7f080c06e870 2024-09-10T11:38:47.945 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-09-10T11:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.947+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07f0075170 msgr2=0x7f07f0077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.947+0000 7f08147e2640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07f0075170 0x7f07f0077630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f080c0693a0 tx=0x7f0804009250 comp rx=0 tx=0).stop 2024-09-10T11:38:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 msgr2=0x7f080c1f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 0x7f080c1f9b90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0808009850 tx=0x7f0808003820 comp rx=0 tx=0).stop 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 shutdown_connections 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07f0075170 0x7f07f0077630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f080c15dbe0 0x7f080c0b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f080c0b3a40 0x7f080c0b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.948+0000 7f08147e2640 1 --2- 172.21.15.57:0/2859118772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f080c06e870 0x7f080c1f9b90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.949+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 >> 172.21.15.57:0/2859118772 conn(0x7f080c0b16f0 msgr2=0x7f080c15bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.949+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 shutdown_connections 2024-09-10T11:38:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.949+0000 7f08147e2640 1 -- 172.21.15.57:0/2859118772 wait complete. 2024-09-10T11:38:47.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-09-10T11:38:47.966 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:47.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.982+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1010005580 con 0x7f1028050d10 2024-09-10T11:38:47.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.983+0000 7f102cff9640 1 -- 172.21.15.57:0/4098454565 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10300ad030 con 0x7f1028050d10 2024-09-10T11:38:47.984 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1014075170 msgr2=0x7f1014077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1014075170 0x7f1014077630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f101c005fd0 tx=0x7f101c00a580 comp rx=0 tx=0).stop 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 msgr2=0x7f1028007e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028007e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f103006b4b0 tx=0x7f10300a89e0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 shutdown_connections 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1014075170 0x7f1014077630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1028050d10 0x7f1028007e30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1028034ba0 0x7f10280078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 --2- 172.21.15.57:0/4098454565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1028008d90 0x7f10280e56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 >> 172.21.15.57:0/4098454565 conn(0x7f102801e890 msgr2=0x7f102800ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 shutdown_connections 2024-09-10T11:38:47.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.985+0000 7f101a7fc640 1 -- 172.21.15.57:0/4098454565 wait complete. 2024-09-10T11:38:47.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.990+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f167406ef50 con 0x7f167415b4d0 2024-09-10T11:38:47.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.990+0000 7f1670ff9640 1 -- 172.21.15.57:0/1456811111 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1668060df0 con 0x7f167415b4d0 2024-09-10T11:38:47.992 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1660075120 msgr2=0x7f16600775e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1660075120 0x7f16600775e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1664001eb0 tx=0x7f16640019f0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 msgr2=0x7f16741faf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 0x7f16741faf20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1668004e80 tx=0x7f1668001630 comp rx=0 tx=0).stop 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 shutdown_connections 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1660075120 0x7f16600775e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741fb460 0x7f16742048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f167415b4d0 0x7f16741faf20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 --2- 172.21.15.57:0/1456811111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165c003a50 0x7f167415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:47.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 >> 172.21.15.57:0/1456811111 conn(0x7f167406d1e0 msgr2=0x7f167415ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:47.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 shutdown_connections 2024-09-10T11:38:47.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.994+0000 7f165a7fc640 1 -- 172.21.15.57:0/1456811111 wait complete. 2024-09-10T11:38:47.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-09-10T11:38:47.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.997+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6488005580 con 0x7f64a815ded0 2024-09-10T11:38:47.998 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:47.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:47.998+0000 7f64a4ff9640 1 -- 172.21.15.57:0/2629631522 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64a0032030 con 0x7f64a815ded0 2024-09-10T11:38:47.999 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.001+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6494075170 msgr2=0x7f6494077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6494075170 0x7f6494077630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6498000f60 tx=0x7f6498009040 comp rx=0 tx=0).stop 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 msgr2=0x7f64a81f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 0x7f64a81f5900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009d60 tx=0x7f64a002c8e0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 shutdown_connections 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6494075170 0x7f6494077630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64a815ded0 0x7f64a81f5900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64a80d45e0 0x7f64a80c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 --2- 172.21.15.57:0/2629631522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64a80d0ce0 0x7f64a81f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 >> 172.21.15.57:0/2629631522 conn(0x7f64a809ce70 msgr2=0x7f64a806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f11e0070250 con 0x7f11e006a6d0 2024-09-10T11:38:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 shutdown_connections 2024-09-10T11:38:48.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.002+0000 7f64ad4e2640 1 -- 172.21.15.57:0/2629631522 wait complete. 2024-09-10T11:38:48.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.003+0000 7f11d5ffb640 1 -- 172.21.15.57:0/3589907605 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11dc05fd50 con 0x7f11e006a6d0 2024-09-10T11:38:48.005 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2024-09-10T11:38:48.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f11c4075170 msgr2=0x7f11c4077630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f11c4075170 0x7f11c4077630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f11d0034000 tx=0x7f11d0004730 comp rx=0 tx=0).stop 2024-09-10T11:38:48.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 msgr2=0x7f11e0201370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 0x7f11e0201370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00d950 tx=0x7f11dc00de10 comp rx=0 tx=0).stop 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 shutdown_connections 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f11c4075170 0x7f11c4077630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00726a0 0x7f11e01f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11e00707a0 0x7f11e009ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 --2- 172.21.15.57:0/3589907605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e006a6d0 0x7f11e0201370 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 >> 172.21.15.57:0/3589907605 conn(0x7f11e00cfd10 msgr2=0x7f11e00acf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 shutdown_connections 2024-09-10T11:38:48.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.006+0000 7f11e73da640 1 -- 172.21.15.57:0/3589907605 wait complete. 2024-09-10T11:38:48.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-09-10T11:38:48.010 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:48.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.013+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7880070400 con 0x7f78800ad890 2024-09-10T11:38:48.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.013+0000 7f78677fe640 1 -- 172.21.15.57:0/3179562334 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f787005fa50 con 0x7f78800ad890 2024-09-10T11:38:48.014 INFO:teuthology.orchestra.run.smithi057.stdout:55834574856 2024-09-10T11:38:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.014+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2488005580 con 0x7f24a000ba30 2024-09-10T11:38:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.015+0000 7f248f7fe640 1 -- 172.21.15.57:0/3002743208 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f249805fc30 con 0x7f24a000ba30 2024-09-10T11:38:48.016 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-09-10T11:38:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f786c0750a0 msgr2=0x7f786c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f786c0750a0 0x7f786c077560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f7874004730 comp rx=0 tx=0).stop 2024-09-10T11:38:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800ad890 msgr2=0x7f7880151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800ad890 0x7f7880151e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f787000c340 tx=0x7f787000c800 comp rx=0 tx=0).stop 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 shutdown_connections 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f786c0750a0 0x7f786c077560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78801582f0 0x7f7880160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78800b3630 0x7f7880143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 --2- 172.21.15.57:0/3179562334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800ad890 0x7f7880151e40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 >> 172.21.15.57:0/3179562334 conn(0x7f788006d1e0 msgr2=0x7f78800b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 shutdown_connections 2024-09-10T11:38:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.016+0000 7f7885223640 1 -- 172.21.15.57:0/3179562334 wait complete. 2024-09-10T11:38:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f24940751a0 msgr2=0x7f2494077660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f24940751a0 0x7f2494077660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24a0189f10 tx=0x7f249c0013c0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 msgr2=0x7f24a00df3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 0x7f24a00df3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2498009fd0 tx=0x7f249800b8e0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 shutdown_connections 2024-09-10T11:38:48.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f24940751a0 0x7f2494077660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a000ba30 0x7f24a00df3e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a0009a80 0x7f24a01870d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 --2- 172.21.15.57:0/3002743208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a0005a90 0x7f24a0189fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 >> 172.21.15.57:0/3002743208 conn(0x7f24a0054590 msgr2=0x7f24a0053120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 shutdown_connections 2024-09-10T11:38:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.017+0000 7f24ad72b640 1 -- 172.21.15.57:0/3002743208 wait complete. 2024-09-10T11:38:48.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-09-10T11:38:48.021 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:48.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.021+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3cc0052e40 con 0x7f3cc0034b90 2024-09-10T11:38:48.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.022+0000 7f3cb3fff640 1 -- 172.21.15.57:0/1920888271 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3cb405fe90 con 0x7f3cc0034b90 2024-09-10T11:38:48.023 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2024-09-10T11:38:48.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-10T11:38:48.024 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3cac0750f0 msgr2=0x7f3cac0775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3cac0750f0 0x7f3cac0775b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009590 tx=0x7f3cbc02bf90 comp rx=0 tx=0).stop 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc0034b90 msgr2=0x7f3cc0179eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc0034b90 0x7f3cc0179eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c390 tx=0x7f3cb400c850 comp rx=0 tx=0).stop 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 shutdown_connections 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3cac0750f0 0x7f3cac0775b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc0050d00 0x7f3cc00d99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc0034b90 0x7f3cc0179eb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 --2- 172.21.15.57:0/1920888271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc0008d80 0x7f3cc004c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 >> 172.21.15.57:0/1920888271 conn(0x7f3cc001e880 msgr2=0x7f3cc000aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 shutdown_connections 2024-09-10T11:38:48.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.024+0000 7f3ccca33640 1 -- 172.21.15.57:0/1920888271 wait complete. 2024-09-10T11:38:48.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-09-10T11:38:48.032 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:48.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-09-10T11:38:48.032 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:48.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-10T11:38:48.037 DEBUG:teuthology.parallel:result is None 2024-09-10T11:38:48.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T11:38:48.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 -- 172.21.15.57:0/2533568372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015bdf0 msgr2=0x7f7a100d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 --2- 172.21.15.57:0/2533568372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015bdf0 0x7f7a100d18e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009830 tx=0x7f7a0402a510 comp rx=0 tx=0).stop 2024-09-10T11:38:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 -- 172.21.15.57:0/2533568372 shutdown_connections 2024-09-10T11:38:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 --2- 172.21.15.57:0/2533568372 >> v2:172.21.15.154:3300/0 conn(0x7f7a100d1e20 0x7f7a100afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 --2- 172.21.15.57:0/2533568372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015bdf0 0x7f7a100d18e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 -- 172.21.15.57:0/2533568372 >> 172.21.15.57:0/2533568372 conn(0x7f7a1009aa20 msgr2=0x7f7a1009ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 -- 172.21.15.57:0/2533568372 shutdown_connections 2024-09-10T11:38:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.181+0000 7f7a152b8640 1 -- 172.21.15.57:0/2533568372 wait complete. 2024-09-10T11:38:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.182+0000 7f7a152b8640 1 Processor -- start 2024-09-10T11:38:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.182+0000 7f7a152b8640 1 -- start start 2024-09-10T11:38:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a152b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a100d1e20 0x7f7a1015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a152b8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015ba10 0x7f7a101f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a152b8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 0x7f7a101f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a152b8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100b0360 con 0x7f7a1015bdf0 2024-09-10T11:38:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a152b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a100b01e0 con 0x7f7a100d1e20 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a152b8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7a100b04e0 con 0x7f7a1015ba10 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a0f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 0x7f7a101f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a0f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 0x7f7a101f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46972/0 (socket says 172.21.15.57:46972) 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a0f7fe640 1 -- 172.21.15.57:0/3782555867 learned_addr learned my addr 172.21.15.57:0/3782555867 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a0effd640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a100d1e20 0x7f7a1015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.183+0000 7f7a0e7fc640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015ba10 0x7f7a101f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0f7fe640 1 -- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015ba10 msgr2=0x7f7a101f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0f7fe640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015ba10 0x7f7a101f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0f7fe640 1 -- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a100d1e20 msgr2=0x7f7a1015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0f7fe640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a100d1e20 0x7f7a1015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0f7fe640 1 -- 172.21.15.57:0/3782555867 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1015e6e0 con 0x7f7a1015bdf0 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0e7fc640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015ba10 0x7f7a101f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:38:48.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a0f7fe640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 0x7f7a101f7dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800efd0 tx=0x7f7a0800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:48.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08003b70 con 0x7f7a1015bdf0 2024-09-10T11:38:48.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a08003e00 con 0x7f7a1015bdf0 2024-09-10T11:38:48.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1015e9c0 con 0x7f7a1015bdf0 2024-09-10T11:38:48.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08004280 con 0x7f7a1015bdf0 2024-09-10T11:38:48.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.184+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1015ef80 con 0x7f7a1015bdf0 2024-09-10T11:38:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.185+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a100b7a60 con 0x7f7a1015bdf0 2024-09-10T11:38:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.185+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f7a08004420 con 0x7f7a1015bdf0 2024-09-10T11:38:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.186+0000 7f79f77fe640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79fc0750a0 0x7f79fc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.186+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a080971f0 con 0x7f7a1015bdf0 2024-09-10T11:38:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.186+0000 7f7a0effd640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79fc0750a0 0x7f79fc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.187+0000 7f7a0effd640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79fc0750a0 0x7f79fc077560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a000017c0 tx=0x7f7a00007e90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:48.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.190+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f7a08061560 con 0x7f7a1015bdf0 2024-09-10T11:38:48.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.349+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a100afa90 con 0x7f79fc0750a0 2024-09-10T11:38:48.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.354+0000 7f79f77fe640 1 -- 172.21.15.57:0/3782555867 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f7a100afa90 con 0x7f79fc0750a0 2024-09-10T11:38:48.358 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:48.359 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79fc0750a0 msgr2=0x7f79fc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79fc0750a0 0x7f79fc077560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a000017c0 tx=0x7f7a00007e90 comp rx=0 tx=0).stop 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 msgr2=0x7f7a101f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 0x7f7a101f7dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800efd0 tx=0x7f7a0800c6a0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 shutdown_connections 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79fc0750a0 0x7f79fc077560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a1015bdf0 0x7f7a101f7dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1015ba10 0x7f7a101f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 --2- 172.21.15.57:0/3782555867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a100d1e20 0x7f7a1015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 >> 172.21.15.57:0/3782555867 conn(0x7f7a1009aa20 msgr2=0x7f7a10070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 shutdown_connections 2024-09-10T11:38:48.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.357+0000 7f7a152b8640 1 -- 172.21.15.57:0/3782555867 wait complete. 2024-09-10T11:38:48.368 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-10T11:38:48.192478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235792,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738928,"statfs":{"total":773094113280,"available":772852662272,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.557912"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166415+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:38:39.166415+0000","last_peered":"2024-09-10T11:38:39.166415+0000","last_clean":"2024-09-10T11:38:39.166415+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:38:39.166415+0000","last_undegraded":"2024-09-10T11:38:39.166415+0000","last_fullsized":"2024-09-10T11:38:39.166415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634990+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:38:37.634990+0000","last_peered":"2024-09-10T11:38:37.634990+0000","last_clean":"2024-09-10T11:38:37.634990+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:38:37.634990+0000","last_undegraded":"2024-09-10T11:38:37.634990+0000","last_fullsized":"2024-09-10T11:38:37.634990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166638+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:38:39.166638+0000","last_peered":"2024-09-10T11:38:39.166638+0000","last_clean":"2024-09-10T11:38:39.166638+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:38:39.166638+0000","last_undegraded":"2024-09-10T11:38:39.166638+0000","last_fullsized":"2024-09-10T11:38:39.166638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636583+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:38:37.636583+0000","last_peered":"2024-09-10T11:38:37.636583+0000","last_clean":"2024-09-10T11:38:37.636583+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:38:37.636583+0000","last_undegraded":"2024-09-10T11:38:37.636583+0000","last_fullsized":"2024-09-10T11:38:37.636583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166387+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:38:39.166387+0000","last_peered":"2024-09-10T11:38:39.166387+0000","last_clean":"2024-09-10T11:38:39.166387+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:38:39.166387+0000","last_undegraded":"2024-09-10T11:38:39.166387+0000","last_fullsized":"2024-09-10T11:38:39.166387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637139+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:38:37.637139+0000","last_peered":"2024-09-10T11:38:37.637139+0000","last_clean":"2024-09-10T11:38:37.637139+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:38:37.637139+0000","last_undegraded":"2024-09-10T11:38:37.637139+0000","last_fullsized":"2024-09-10T11:38:37.637139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165949+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:38:39.165949+0000","last_peered":"2024-09-10T11:38:39.165949+0000","last_clean":"2024-09-10T11:38:39.165949+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:38:39.165949+0000","last_undegraded":"2024-09-10T11:38:39.165949+0000","last_fullsized":"2024-09-10T11:38:39.165949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137244+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:38:39.137244+0000","last_peered":"2024-09-10T11:38:39.137244+0000","last_clean":"2024-09-10T11:38:39.137244+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:38:39.137244+0000","last_undegraded":"2024-09-10T11:38:39.137244+0000","last_fullsized":"2024-09-10T11:38:39.137244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166432+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:38:39.166432+0000","last_peered":"2024-09-10T11:38:39.166432+0000","last_clean":"2024-09-10T11:38:39.166432+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:38:39.166432+0000","last_undegraded":"2024-09-10T11:38:39.166432+0000","last_fullsized":"2024-09-10T11:38:39.166432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638355+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:38:38.638355+0000","last_peered":"2024-09-10T11:38:38.638355+0000","last_clean":"2024-09-10T11:38:38.638355+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:38:38.638355+0000","last_undegraded":"2024-09-10T11:38:38.638355+0000","last_fullsized":"2024-09-10T11:38:38.638355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638239+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:38:38.638239+0000","last_peered":"2024-09-10T11:38:38.638239+0000","last_clean":"2024-09-10T11:38:38.638239+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:38:38.638239+0000","last_undegraded":"2024-09-10T11:38:38.638239+0000","last_fullsized":"2024-09-10T11:38:38.638239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637846+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:38:37.637846+0000","last_peered":"2024-09-10T11:38:37.637846+0000","last_clean":"2024-09-10T11:38:37.637846+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:38:37.637846+0000","last_undegraded":"2024-09-10T11:38:37.637846+0000","last_fullsized":"2024-09-10T11:38:37.637846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137648+0000","last_change":"2024-09-10T11:38:36.649867+0000","last_active":"2024-09-10T11:38:39.137648+0000","last_peered":"2024-09-10T11:38:39.137648+0000","last_clean":"2024-09-10T11:38:39.137648+0000","last_became_active":"2024-09-10T11:38:36.648237+0000","last_became_peered":"2024-09-10T11:38:36.648237+0000","last_unstale":"2024-09-10T11:38:39.137648+0000","last_undegraded":"2024-09-10T11:38:39.137648+0000","last_fullsized":"2024-09-10T11:38:39.137648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166145+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:38:39.166145+0000","last_peered":"2024-09-10T11:38:39.166145+0000","last_clean":"2024-09-10T11:38:39.166145+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:38:39.166145+0000","last_undegraded":"2024-09-10T11:38:39.166145+0000","last_fullsized":"2024-09-10T11:38:39.166145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634591+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:38:37.634591+0000","last_peered":"2024-09-10T11:38:37.634591+0000","last_clean":"2024-09-10T11:38:37.634591+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:38:37.634591+0000","last_undegraded":"2024-09-10T11:38:37.634591+0000","last_fullsized":"2024-09-10T11:38:37.634591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636309+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:38:37.636309+0000","last_peered":"2024-09-10T11:38:37.636309+0000","last_clean":"2024-09-10T11:38:37.636309+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:38:37.636309+0000","last_undegraded":"2024-09-10T11:38:37.636309+0000","last_fullsized":"2024-09-10T11:38:37.636309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637255+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:38:37.637255+0000","last_peered":"2024-09-10T11:38:37.637255+0000","last_clean":"2024-09-10T11:38:37.637255+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:38:37.637255+0000","last_undegraded":"2024-09-10T11:38:37.637255+0000","last_fullsized":"2024-09-10T11:38:37.637255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165966+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:38:39.165966+0000","last_peered":"2024-09-10T11:38:39.165966+0000","last_clean":"2024-09-10T11:38:39.165966+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:38:39.165966+0000","last_undegraded":"2024-09-10T11:38:39.165966+0000","last_fullsized":"2024-09-10T11:38:39.165966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166663+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:38:39.166663+0000","last_peered":"2024-09-10T11:38:39.166663+0000","last_clean":"2024-09-10T11:38:39.166663+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:38:39.166663+0000","last_undegraded":"2024-09-10T11:38:39.166663+0000","last_fullsized":"2024-09-10T11:38:39.166663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638287+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:38:38.638287+0000","last_peered":"2024-09-10T11:38:38.638287+0000","last_clean":"2024-09-10T11:38:38.638287+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:38:38.638287+0000","last_undegraded":"2024-09-10T11:38:38.638287+0000","last_fullsized":"2024-09-10T11:38:38.638287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166357+0000","last_change":"2024-09-10T11:38:36.643946+0000","last_active":"2024-09-10T11:38:39.166357+0000","last_peered":"2024-09-10T11:38:39.166357+0000","last_clean":"2024-09-10T11:38:39.166357+0000","last_became_active":"2024-09-10T11:38:36.643648+0000","last_became_peered":"2024-09-10T11:38:36.643648+0000","last_unstale":"2024-09-10T11:38:39.166357+0000","last_undegraded":"2024-09-10T11:38:39.166357+0000","last_fullsized":"2024-09-10T11:38:39.166357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637479+0000","last_change":"2024-09-10T11:38:36.643116+0000","last_active":"2024-09-10T11:38:37.637479+0000","last_peered":"2024-09-10T11:38:37.637479+0000","last_clean":"2024-09-10T11:38:37.637479+0000","last_became_active":"2024-09-10T11:38:36.642805+0000","last_became_peered":"2024-09-10T11:38:36.642805+0000","last_unstale":"2024-09-10T11:38:37.637479+0000","last_undegraded":"2024-09-10T11:38:37.637479+0000","last_fullsized":"2024-09-10T11:38:37.637479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:53.917503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137290+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:38:39.137290+0000","last_peered":"2024-09-10T11:38:39.137290+0000","last_clean":"2024-09-10T11:38:39.137290+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:38:39.137290+0000","last_undegraded":"2024-09-10T11:38:39.137290+0000","last_fullsized":"2024-09-10T11:38:39.137290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636477+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:38:37.636477+0000","last_peered":"2024-09-10T11:38:37.636477+0000","last_clean":"2024-09-10T11:38:37.636477+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:38:37.636477+0000","last_undegraded":"2024-09-10T11:38:37.636477+0000","last_fullsized":"2024-09-10T11:38:37.636477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137797+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:38:39.137797+0000","last_peered":"2024-09-10T11:38:39.137797+0000","last_clean":"2024-09-10T11:38:39.137797+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:38:39.137797+0000","last_undegraded":"2024-09-10T11:38:39.137797+0000","last_fullsized":"2024-09-10T11:38:39.137797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638350+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:38:38.638350+0000","last_peered":"2024-09-10T11:38:38.638350+0000","last_clean":"2024-09-10T11:38:38.638350+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:38:38.638350+0000","last_undegraded":"2024-09-10T11:38:38.638350+0000","last_fullsized":"2024-09-10T11:38:38.638350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634892+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:38:37.634892+0000","last_peered":"2024-09-10T11:38:37.634892+0000","last_clean":"2024-09-10T11:38:37.634892+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:38:37.634892+0000","last_undegraded":"2024-09-10T11:38:37.634892+0000","last_fullsized":"2024-09-10T11:38:37.634892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137925+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:38:39.137925+0000","last_peered":"2024-09-10T11:38:39.137925+0000","last_clean":"2024-09-10T11:38:39.137925+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:38:39.137925+0000","last_undegraded":"2024-09-10T11:38:39.137925+0000","last_fullsized":"2024-09-10T11:38:39.137925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166405+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:38:39.166405+0000","last_peered":"2024-09-10T11:38:39.166405+0000","last_clean":"2024-09-10T11:38:39.166405+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:38:39.166405+0000","last_undegraded":"2024-09-10T11:38:39.166405+0000","last_fullsized":"2024-09-10T11:38:39.166405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637858+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:38:37.637858+0000","last_peered":"2024-09-10T11:38:37.637858+0000","last_clean":"2024-09-10T11:38:37.637858+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:38:37.637858+0000","last_undegraded":"2024-09-10T11:38:37.637858+0000","last_fullsized":"2024-09-10T11:38:37.637858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165985+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:38:39.165985+0000","last_peered":"2024-09-10T11:38:39.165985+0000","last_clean":"2024-09-10T11:38:39.165985+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:38:39.165985+0000","last_undegraded":"2024-09-10T11:38:39.165985+0000","last_fullsized":"2024-09-10T11:38:39.165985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638232+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:38:38.638232+0000","last_peered":"2024-09-10T11:38:38.638232+0000","last_clean":"2024-09-10T11:38:38.638232+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:38:38.638232+0000","last_undegraded":"2024-09-10T11:38:38.638232+0000","last_fullsized":"2024-09-10T11:38:38.638232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636281+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:38:37.636281+0000","last_peered":"2024-09-10T11:38:37.636281+0000","last_clean":"2024-09-10T11:38:37.636281+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:38:37.636281+0000","last_undegraded":"2024-09-10T11:38:37.636281+0000","last_fullsized":"2024-09-10T11:38:37.636281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137814+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:38:39.137814+0000","last_peered":"2024-09-10T11:38:39.137814+0000","last_clean":"2024-09-10T11:38:39.137814+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:38:39.137814+0000","last_undegraded":"2024-09-10T11:38:39.137814+0000","last_fullsized":"2024-09-10T11:38:39.137814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166662+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:38:39.166662+0000","last_peered":"2024-09-10T11:38:39.166662+0000","last_clean":"2024-09-10T11:38:39.166662+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:38:39.166662+0000","last_undegraded":"2024-09-10T11:38:39.166662+0000","last_fullsized":"2024-09-10T11:38:39.166662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637823+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:38:38.637823+0000","last_peered":"2024-09-10T11:38:38.637823+0000","last_clean":"2024-09-10T11:38:38.637823+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:38:38.637823+0000","last_undegraded":"2024-09-10T11:38:38.637823+0000","last_fullsized":"2024-09-10T11:38:38.637823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137316+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:38:39.137316+0000","last_peered":"2024-09-10T11:38:39.137316+0000","last_clean":"2024-09-10T11:38:39.137316+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:38:39.137316+0000","last_undegraded":"2024-09-10T11:38:39.137316+0000","last_fullsized":"2024-09-10T11:38:39.137316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137319+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:38:39.137319+0000","last_peered":"2024-09-10T11:38:39.137319+0000","last_clean":"2024-09-10T11:38:39.137319+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:38:39.137319+0000","last_undegraded":"2024-09-10T11:38:39.137319+0000","last_fullsized":"2024-09-10T11:38:39.137319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636420+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:38:37.636420+0000","last_peered":"2024-09-10T11:38:37.636420+0000","last_clean":"2024-09-10T11:38:37.636420+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:38:37.636420+0000","last_undegraded":"2024-09-10T11:38:37.636420+0000","last_fullsized":"2024-09-10T11:38:37.636420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634585+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:38:37.634585+0000","last_peered":"2024-09-10T11:38:37.634585+0000","last_clean":"2024-09-10T11:38:37.634585+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:38:37.634585+0000","last_undegraded":"2024-09-10T11:38:37.634585+0000","last_fullsized":"2024-09-10T11:38:37.634585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638124+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:38:38.638124+0000","last_peered":"2024-09-10T11:38:38.638124+0000","last_clean":"2024-09-10T11:38:38.638124+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:38:38.638124+0000","last_undegraded":"2024-09-10T11:38:38.638124+0000","last_fullsized":"2024-09-10T11:38:38.638124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636901+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:38:37.636901+0000","last_peered":"2024-09-10T11:38:37.636901+0000","last_clean":"2024-09-10T11:38:37.636901+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:38:37.636901+0000","last_undegraded":"2024-09-10T11:38:37.636901+0000","last_fullsized":"2024-09-10T11:38:37.636901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636860+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:38:37.636860+0000","last_peered":"2024-09-10T11:38:37.636860+0000","last_clean":"2024-09-10T11:38:37.636860+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:38:37.636860+0000","last_undegraded":"2024-09-10T11:38:37.636860+0000","last_fullsized":"2024-09-10T11:38:37.636860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166003+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:38:39.166003+0000","last_peered":"2024-09-10T11:38:39.166003+0000","last_clean":"2024-09-10T11:38:39.166003+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:38:39.166003+0000","last_undegraded":"2024-09-10T11:38:39.166003+0000","last_fullsized":"2024-09-10T11:38:39.166003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634824+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:38:37.634824+0000","last_peered":"2024-09-10T11:38:37.634824+0000","last_clean":"2024-09-10T11:38:37.634824+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:38:37.634824+0000","last_undegraded":"2024-09-10T11:38:37.634824+0000","last_fullsized":"2024-09-10T11:38:37.634824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637941+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:38:37.637941+0000","last_peered":"2024-09-10T11:38:37.637941+0000","last_clean":"2024-09-10T11:38:37.637941+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:38:37.637941+0000","last_undegraded":"2024-09-10T11:38:37.637941+0000","last_fullsized":"2024-09-10T11:38:37.637941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637984+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:38:38.637984+0000","last_peered":"2024-09-10T11:38:38.637984+0000","last_clean":"2024-09-10T11:38:38.637984+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:38:38.637984+0000","last_undegraded":"2024-09-10T11:38:38.637984+0000","last_fullsized":"2024-09-10T11:38:38.637984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166328+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:38:39.166328+0000","last_peered":"2024-09-10T11:38:39.166328+0000","last_clean":"2024-09-10T11:38:39.166328+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:38:39.166328+0000","last_undegraded":"2024-09-10T11:38:39.166328+0000","last_fullsized":"2024-09-10T11:38:39.166328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166556+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:38:39.166556+0000","last_peered":"2024-09-10T11:38:39.166556+0000","last_clean":"2024-09-10T11:38:39.166556+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:38:39.166556+0000","last_undegraded":"2024-09-10T11:38:39.166556+0000","last_fullsized":"2024-09-10T11:38:39.166556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166356+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:38:39.166356+0000","last_peered":"2024-09-10T11:38:39.166356+0000","last_clean":"2024-09-10T11:38:39.166356+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:38:39.166356+0000","last_undegraded":"2024-09-10T11:38:39.166356+0000","last_fullsized":"2024-09-10T11:38:39.166356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637603+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:38:37.637603+0000","last_peered":"2024-09-10T11:38:37.637603+0000","last_clean":"2024-09-10T11:38:37.637603+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:38:37.637603+0000","last_undegraded":"2024-09-10T11:38:37.637603+0000","last_fullsized":"2024-09-10T11:38:37.637603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166332+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:38:39.166332+0000","last_peered":"2024-09-10T11:38:39.166332+0000","last_clean":"2024-09-10T11:38:39.166332+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:38:39.166332+0000","last_undegraded":"2024-09-10T11:38:39.166332+0000","last_fullsized":"2024-09-10T11:38:39.166332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637806+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:38:38.637806+0000","last_peered":"2024-09-10T11:38:38.637806+0000","last_clean":"2024-09-10T11:38:38.637806+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:38:38.637806+0000","last_undegraded":"2024-09-10T11:38:38.637806+0000","last_fullsized":"2024-09-10T11:38:38.637806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638020+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:38:38.638020+0000","last_peered":"2024-09-10T11:38:38.638020+0000","last_clean":"2024-09-10T11:38:38.638020+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:38:38.638020+0000","last_undegraded":"2024-09-10T11:38:38.638020+0000","last_fullsized":"2024-09-10T11:38:38.638020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165609+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:38:39.165609+0000","last_peered":"2024-09-10T11:38:39.165609+0000","last_clean":"2024-09-10T11:38:39.165609+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:38:39.165609+0000","last_undegraded":"2024-09-10T11:38:39.165609+0000","last_fullsized":"2024-09-10T11:38:39.165609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166134+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:38:39.166134+0000","last_peered":"2024-09-10T11:38:39.166134+0000","last_clean":"2024-09-10T11:38:39.166134+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:38:39.166134+0000","last_undegraded":"2024-09-10T11:38:39.166134+0000","last_fullsized":"2024-09-10T11:38:39.166134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637534+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:38:37.637534+0000","last_peered":"2024-09-10T11:38:37.637534+0000","last_clean":"2024-09-10T11:38:37.637534+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:38:37.637534+0000","last_undegraded":"2024-09-10T11:38:37.637534+0000","last_fullsized":"2024-09-10T11:38:37.637534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166467+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:38:39.166467+0000","last_peered":"2024-09-10T11:38:39.166467+0000","last_clean":"2024-09-10T11:38:39.166467+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:38:39.166467+0000","last_undegraded":"2024-09-10T11:38:39.166467+0000","last_fullsized":"2024-09-10T11:38:39.166467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166064+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:38:39.166064+0000","last_peered":"2024-09-10T11:38:39.166064+0000","last_clean":"2024-09-10T11:38:39.166064+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:38:39.166064+0000","last_undegraded":"2024-09-10T11:38:39.166064+0000","last_fullsized":"2024-09-10T11:38:39.166064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166661+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:38:39.166661+0000","last_peered":"2024-09-10T11:38:39.166661+0000","last_clean":"2024-09-10T11:38:39.166661+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:38:39.166661+0000","last_undegraded":"2024-09-10T11:38:39.166661+0000","last_fullsized":"2024-09-10T11:38:39.166661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634985+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:38:37.634985+0000","last_peered":"2024-09-10T11:38:37.634985+0000","last_clean":"2024-09-10T11:38:37.634985+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:38:37.634985+0000","last_undegraded":"2024-09-10T11:38:37.634985+0000","last_fullsized":"2024-09-10T11:38:37.634985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636810+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:38:37.636810+0000","last_peered":"2024-09-10T11:38:37.636810+0000","last_clean":"2024-09-10T11:38:37.636810+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:38:37.636810+0000","last_undegraded":"2024-09-10T11:38:37.636810+0000","last_fullsized":"2024-09-10T11:38:37.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165675+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:38:39.165675+0000","last_peered":"2024-09-10T11:38:39.165675+0000","last_clean":"2024-09-10T11:38:39.165675+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:38:39.165675+0000","last_undegraded":"2024-09-10T11:38:39.165675+0000","last_fullsized":"2024-09-10T11:38:39.165675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166382+0000","last_change":"2024-09-10T11:38:36.653163+0000","last_active":"2024-09-10T11:38:39.166382+0000","last_peered":"2024-09-10T11:38:39.166382+0000","last_clean":"2024-09-10T11:38:39.166382+0000","last_became_active":"2024-09-10T11:38:36.652861+0000","last_became_peered":"2024-09-10T11:38:36.652861+0000","last_unstale":"2024-09-10T11:38:39.166382+0000","last_undegraded":"2024-09-10T11:38:39.166382+0000","last_fullsized":"2024-09-10T11:38:39.166382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165892+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:39.165892+0000","last_peered":"2024-09-10T11:38:39.165892+0000","last_clean":"2024-09-10T11:38:39.165892+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:39.165892+0000","last_undegraded":"2024-09-10T11:38:39.165892+0000","last_fullsized":"2024-09-10T11:38:39.165892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636247+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:38:37.636247+0000","last_peered":"2024-09-10T11:38:37.636247+0000","last_clean":"2024-09-10T11:38:37.636247+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:38:37.636247+0000","last_undegraded":"2024-09-10T11:38:37.636247+0000","last_fullsized":"2024-09-10T11:38:37.636247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137684+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:38:39.137684+0000","last_peered":"2024-09-10T11:38:39.137684+0000","last_clean":"2024-09-10T11:38:39.137684+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:38:39.137684+0000","last_undegraded":"2024-09-10T11:38:39.137684+0000","last_fullsized":"2024-09-10T11:38:39.137684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166230+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:38:39.166230+0000","last_peered":"2024-09-10T11:38:39.166230+0000","last_clean":"2024-09-10T11:38:39.166230+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:38:39.166230+0000","last_undegraded":"2024-09-10T11:38:39.166230+0000","last_fullsized":"2024-09-10T11:38:39.166230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165865+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:38:39.165865+0000","last_peered":"2024-09-10T11:38:39.165865+0000","last_clean":"2024-09-10T11:38:39.165865+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:38:39.165865+0000","last_undegraded":"2024-09-10T11:38:39.165865+0000","last_fullsized":"2024-09-10T11:38:39.165865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166086+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:38:39.166086+0000","last_peered":"2024-09-10T11:38:39.166086+0000","last_clean":"2024-09-10T11:38:39.166086+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:38:39.166086+0000","last_undegraded":"2024-09-10T11:38:39.166086+0000","last_fullsized":"2024-09-10T11:38:39.166086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634619+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:38:37.634619+0000","last_peered":"2024-09-10T11:38:37.634619+0000","last_clean":"2024-09-10T11:38:37.634619+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:38:37.634619+0000","last_undegraded":"2024-09-10T11:38:37.634619+0000","last_fullsized":"2024-09-10T11:38:37.634619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637700+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:38:37.637700+0000","last_peered":"2024-09-10T11:38:37.637700+0000","last_clean":"2024-09-10T11:38:37.637700+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:38:37.637700+0000","last_undegraded":"2024-09-10T11:38:37.637700+0000","last_fullsized":"2024-09-10T11:38:37.637700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637363+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:38:37.637363+0000","last_peered":"2024-09-10T11:38:37.637363+0000","last_clean":"2024-09-10T11:38:37.637363+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:38:37.637363+0000","last_undegraded":"2024-09-10T11:38:37.637363+0000","last_fullsized":"2024-09-10T11:38:37.637363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634761+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:38:37.634761+0000","last_peered":"2024-09-10T11:38:37.634761+0000","last_clean":"2024-09-10T11:38:37.634761+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:38:37.634761+0000","last_undegraded":"2024-09-10T11:38:37.634761+0000","last_fullsized":"2024-09-10T11:38:37.634761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636997+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:38:37.636997+0000","last_peered":"2024-09-10T11:38:37.636997+0000","last_clean":"2024-09-10T11:38:37.636997+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:38:37.636997+0000","last_undegraded":"2024-09-10T11:38:37.636997+0000","last_fullsized":"2024-09-10T11:38:37.636997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166586+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:38:39.166586+0000","last_peered":"2024-09-10T11:38:39.166586+0000","last_clean":"2024-09-10T11:38:39.166586+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:38:39.166586+0000","last_undegraded":"2024-09-10T11:38:39.166586+0000","last_fullsized":"2024-09-10T11:38:39.166586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634718+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:38:37.634718+0000","last_peered":"2024-09-10T11:38:37.634718+0000","last_clean":"2024-09-10T11:38:37.634718+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:38:37.634718+0000","last_undegraded":"2024-09-10T11:38:37.634718+0000","last_fullsized":"2024-09-10T11:38:37.634718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637077+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:38:38.637077+0000","last_peered":"2024-09-10T11:38:38.637077+0000","last_clean":"2024-09-10T11:38:38.637077+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:38:38.637077+0000","last_undegraded":"2024-09-10T11:38:38.637077+0000","last_fullsized":"2024-09-10T11:38:38.637077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137549+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:38:39.137549+0000","last_peered":"2024-09-10T11:38:39.137549+0000","last_clean":"2024-09-10T11:38:39.137549+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:38:39.137549+0000","last_undegraded":"2024-09-10T11:38:39.137549+0000","last_fullsized":"2024-09-10T11:38:39.137549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638190+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:38:38.638190+0000","last_peered":"2024-09-10T11:38:38.638190+0000","last_clean":"2024-09-10T11:38:38.638190+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:38:38.638190+0000","last_undegraded":"2024-09-10T11:38:38.638190+0000","last_fullsized":"2024-09-10T11:38:38.638190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166762+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:38:39.166762+0000","last_peered":"2024-09-10T11:38:39.166762+0000","last_clean":"2024-09-10T11:38:39.166762+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:38:39.166762+0000","last_undegraded":"2024-09-10T11:38:39.166762+0000","last_fullsized":"2024-09-10T11:38:39.166762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165790+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:38:39.165790+0000","last_peered":"2024-09-10T11:38:39.165790+0000","last_clean":"2024-09-10T11:38:39.165790+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:38:39.165790+0000","last_undegraded":"2024-09-10T11:38:39.165790+0000","last_fullsized":"2024-09-10T11:38:39.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636602+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:38:37.636602+0000","last_peered":"2024-09-10T11:38:37.636602+0000","last_clean":"2024-09-10T11:38:37.636602+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:38:37.636602+0000","last_undegraded":"2024-09-10T11:38:37.636602+0000","last_fullsized":"2024-09-10T11:38:37.636602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634705+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:38:37.634705+0000","last_peered":"2024-09-10T11:38:37.634705+0000","last_clean":"2024-09-10T11:38:37.634705+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:38:37.634705+0000","last_undegraded":"2024-09-10T11:38:37.634705+0000","last_fullsized":"2024-09-10T11:38:37.634705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137451+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:38:39.137451+0000","last_peered":"2024-09-10T11:38:39.137451+0000","last_clean":"2024-09-10T11:38:39.137451+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:38:39.137451+0000","last_undegraded":"2024-09-10T11:38:39.137451+0000","last_fullsized":"2024-09-10T11:38:39.137451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634609+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:38:37.634609+0000","last_peered":"2024-09-10T11:38:37.634609+0000","last_clean":"2024-09-10T11:38:37.634609+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:38:37.634609+0000","last_undegraded":"2024-09-10T11:38:37.634609+0000","last_fullsized":"2024-09-10T11:38:37.634609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137860+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:38:39.137860+0000","last_peered":"2024-09-10T11:38:39.137860+0000","last_clean":"2024-09-10T11:38:39.137860+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:38:39.137860+0000","last_undegraded":"2024-09-10T11:38:39.137860+0000","last_fullsized":"2024-09-10T11:38:39.137860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166497+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:38:39.166497+0000","last_peered":"2024-09-10T11:38:39.166497+0000","last_clean":"2024-09-10T11:38:39.166497+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:38:39.166497+0000","last_undegraded":"2024-09-10T11:38:39.166497+0000","last_fullsized":"2024-09-10T11:38:39.166497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638081+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:38:38.638081+0000","last_peered":"2024-09-10T11:38:38.638081+0000","last_clean":"2024-09-10T11:38:38.638081+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:38:38.638081+0000","last_undegraded":"2024-09-10T11:38:38.638081+0000","last_fullsized":"2024-09-10T11:38:38.638081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637039+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:38:37.637039+0000","last_peered":"2024-09-10T11:38:37.637039+0000","last_clean":"2024-09-10T11:38:37.637039+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:38:37.637039+0000","last_undegraded":"2024-09-10T11:38:37.637039+0000","last_fullsized":"2024-09-10T11:38:37.637039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166074+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:38:39.166074+0000","last_peered":"2024-09-10T11:38:39.166074+0000","last_clean":"2024-09-10T11:38:39.166074+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:38:39.166074+0000","last_undegraded":"2024-09-10T11:38:39.166074+0000","last_fullsized":"2024-09-10T11:38:39.166074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636640+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:38:37.636640+0000","last_peered":"2024-09-10T11:38:37.636640+0000","last_clean":"2024-09-10T11:38:37.636640+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:38:37.636640+0000","last_undegraded":"2024-09-10T11:38:37.636640+0000","last_fullsized":"2024-09-10T11:38:37.636640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166462+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:38:39.166462+0000","last_peered":"2024-09-10T11:38:39.166462+0000","last_clean":"2024-09-10T11:38:39.166462+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:38:39.166462+0000","last_undegraded":"2024-09-10T11:38:39.166462+0000","last_fullsized":"2024-09-10T11:38:39.166462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165811+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:38:39.165811+0000","last_peered":"2024-09-10T11:38:39.165811+0000","last_clean":"2024-09-10T11:38:39.165811+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:38:39.165811+0000","last_undegraded":"2024-09-10T11:38:39.165811+0000","last_fullsized":"2024-09-10T11:38:39.165811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137626+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:38:39.137626+0000","last_peered":"2024-09-10T11:38:39.137626+0000","last_clean":"2024-09-10T11:38:39.137626+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:38:39.137626+0000","last_undegraded":"2024-09-10T11:38:39.137626+0000","last_fullsized":"2024-09-10T11:38:39.137626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.138032+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:38:39.138032+0000","last_peered":"2024-09-10T11:38:39.138032+0000","last_clean":"2024-09-10T11:38:39.138032+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:38:39.138032+0000","last_undegraded":"2024-09-10T11:38:39.138032+0000","last_fullsized":"2024-09-10T11:38:39.138032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166800+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:38:39.166800+0000","last_peered":"2024-09-10T11:38:39.166800+0000","last_clean":"2024-09-10T11:38:39.166800+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:38:39.166800+0000","last_undegraded":"2024-09-10T11:38:39.166800+0000","last_fullsized":"2024-09-10T11:38:39.166800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:48.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:38:48.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 -- 172.21.15.57:0/3462805898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe97815dbf0 msgr2=0x7fe9780d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/3462805898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe97815dbf0 0x7fe9780d10d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9780d0300 tx=0x7fe97002a8b0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 -- 172.21.15.57:0/3462805898 shutdown_connections 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/3462805898 >> v2:172.21.15.154:3300/0 conn(0x7fe9780d1940 0x7fe9780d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/3462805898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe97815dbf0 0x7fe9780d10d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 -- 172.21.15.57:0/3462805898 >> 172.21.15.57:0/3462805898 conn(0x7fe97808d6d0 msgr2=0x7fe97809cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 -- 172.21.15.57:0/3462805898 shutdown_connections 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.513+0000 7fe97d9d1640 1 -- 172.21.15.57:0/3462805898 wait complete. 2024-09-10T11:38:48.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.514+0000 7fe97d9d1640 1 Processor -- start 2024-09-10T11:38:48.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 -- start start 2024-09-10T11:38:48.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 0x7fe9780b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780d3f60 0x7fe978153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe97815dbf0 0x7fe9780b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780cfba0 con 0x7fe9780d1940 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780cfa20 con 0x7fe9780d3f60 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.515+0000 7fe97d9d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe9780cfd20 con 0x7fe97815dbf0 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 0x7fe9780b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 0x7fe9780b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46984/0 (socket says 172.21.15.57:46984) 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 -- 172.21.15.57:0/4177914027 learned_addr learned my addr 172.21.15.57:0/4177914027 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe9767fc640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780d3f60 0x7fe978153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 -- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe97815dbf0 msgr2=0x7fe9780b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe9777fe640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe97815dbf0 0x7fe9780b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe97815dbf0 0x7fe9780b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 -- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780d3f60 msgr2=0x7fe978153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780d3f60 0x7fe978153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 -- 172.21.15.57:0/4177914027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe978154010 con 0x7fe9780d1940 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe9767fc640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780d3f60 0x7fe978153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe976ffd640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 0x7fe9780b8400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe970009b30 tx=0x7fe9700039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970040070 con 0x7fe9780d1940 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe970004130 con 0x7fe9780d1940 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe978155350 con 0x7fe9780d1940 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970004580 con 0x7fe9780d1940 2024-09-10T11:38:48.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.516+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe978154590 con 0x7fe9780d1940 2024-09-10T11:38:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.517+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9780d3a20 con 0x7fe9780d1940 2024-09-10T11:38:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.518+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fe970039040 con 0x7fe9780d1940 2024-09-10T11:38:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.518+0000 7fe96ffff640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe9580750a0 0x7fe958077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.519+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9700b7b20 con 0x7fe9780d1940 2024-09-10T11:38:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.519+0000 7fe9767fc640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe9580750a0 0x7fe958077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.519+0000 7fe9767fc640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe9580750a0 0x7fe958077560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe97806e430 tx=0x7fe960005db0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:48.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.522+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fe970081e80 con 0x7fe9780d1940 2024-09-10T11:38:48.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.680+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9780b9cf0 con 0x7fe9580750a0 2024-09-10T11:38:48.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.684+0000 7fe96ffff640 1 -- 172.21.15.57:0/4177914027 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fe9780b9cf0 con 0x7fe9580750a0 2024-09-10T11:38:48.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:48.689 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:38:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe9580750a0 msgr2=0x7fe958077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe9580750a0 0x7fe958077560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe97806e430 tx=0x7fe960005db0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 msgr2=0x7fe9780b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 0x7fe9780b8400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe970009b30 tx=0x7fe9700039f0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 shutdown_connections 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe9580750a0 0x7fe958077560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe97815dbf0 0x7fe9780b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780d3f60 0x7fe978153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.687+0000 7fe97d9d1640 1 --2- 172.21.15.57:0/4177914027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9780d1940 0x7fe9780b8400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.688+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 >> 172.21.15.57:0/4177914027 conn(0x7fe97808d6d0 msgr2=0x7fe9780b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.688+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 shutdown_connections 2024-09-10T11:38:48.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.688+0000 7fe97d9d1640 1 -- 172.21.15.57:0/4177914027 wait complete. 2024-09-10T11:38:48.699 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-10T11:38:48.192478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235792,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738928,"statfs":{"total":773094113280,"available":772852662272,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.557912"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166415+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:38:39.166415+0000","last_peered":"2024-09-10T11:38:39.166415+0000","last_clean":"2024-09-10T11:38:39.166415+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:38:39.166415+0000","last_undegraded":"2024-09-10T11:38:39.166415+0000","last_fullsized":"2024-09-10T11:38:39.166415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634990+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:38:37.634990+0000","last_peered":"2024-09-10T11:38:37.634990+0000","last_clean":"2024-09-10T11:38:37.634990+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:38:37.634990+0000","last_undegraded":"2024-09-10T11:38:37.634990+0000","last_fullsized":"2024-09-10T11:38:37.634990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166638+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:38:39.166638+0000","last_peered":"2024-09-10T11:38:39.166638+0000","last_clean":"2024-09-10T11:38:39.166638+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:38:39.166638+0000","last_undegraded":"2024-09-10T11:38:39.166638+0000","last_fullsized":"2024-09-10T11:38:39.166638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636583+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:38:37.636583+0000","last_peered":"2024-09-10T11:38:37.636583+0000","last_clean":"2024-09-10T11:38:37.636583+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:38:37.636583+0000","last_undegraded":"2024-09-10T11:38:37.636583+0000","last_fullsized":"2024-09-10T11:38:37.636583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166387+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:38:39.166387+0000","last_peered":"2024-09-10T11:38:39.166387+0000","last_clean":"2024-09-10T11:38:39.166387+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:38:39.166387+0000","last_undegraded":"2024-09-10T11:38:39.166387+0000","last_fullsized":"2024-09-10T11:38:39.166387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637139+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:38:37.637139+0000","last_peered":"2024-09-10T11:38:37.637139+0000","last_clean":"2024-09-10T11:38:37.637139+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:38:37.637139+0000","last_undegraded":"2024-09-10T11:38:37.637139+0000","last_fullsized":"2024-09-10T11:38:37.637139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165949+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:38:39.165949+0000","last_peered":"2024-09-10T11:38:39.165949+0000","last_clean":"2024-09-10T11:38:39.165949+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:38:39.165949+0000","last_undegraded":"2024-09-10T11:38:39.165949+0000","last_fullsized":"2024-09-10T11:38:39.165949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137244+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:38:39.137244+0000","last_peered":"2024-09-10T11:38:39.137244+0000","last_clean":"2024-09-10T11:38:39.137244+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:38:39.137244+0000","last_undegraded":"2024-09-10T11:38:39.137244+0000","last_fullsized":"2024-09-10T11:38:39.137244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166432+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:38:39.166432+0000","last_peered":"2024-09-10T11:38:39.166432+0000","last_clean":"2024-09-10T11:38:39.166432+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:38:39.166432+0000","last_undegraded":"2024-09-10T11:38:39.166432+0000","last_fullsized":"2024-09-10T11:38:39.166432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638355+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:38:38.638355+0000","last_peered":"2024-09-10T11:38:38.638355+0000","last_clean":"2024-09-10T11:38:38.638355+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:38:38.638355+0000","last_undegraded":"2024-09-10T11:38:38.638355+0000","last_fullsized":"2024-09-10T11:38:38.638355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638239+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:38:38.638239+0000","last_peered":"2024-09-10T11:38:38.638239+0000","last_clean":"2024-09-10T11:38:38.638239+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:38:38.638239+0000","last_undegraded":"2024-09-10T11:38:38.638239+0000","last_fullsized":"2024-09-10T11:38:38.638239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637846+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:38:37.637846+0000","last_peered":"2024-09-10T11:38:37.637846+0000","last_clean":"2024-09-10T11:38:37.637846+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:38:37.637846+0000","last_undegraded":"2024-09-10T11:38:37.637846+0000","last_fullsized":"2024-09-10T11:38:37.637846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137648+0000","last_change":"2024-09-10T11:38:36.649867+0000","last_active":"2024-09-10T11:38:39.137648+0000","last_peered":"2024-09-10T11:38:39.137648+0000","last_clean":"2024-09-10T11:38:39.137648+0000","last_became_active":"2024-09-10T11:38:36.648237+0000","last_became_peered":"2024-09-10T11:38:36.648237+0000","last_unstale":"2024-09-10T11:38:39.137648+0000","last_undegraded":"2024-09-10T11:38:39.137648+0000","last_fullsized":"2024-09-10T11:38:39.137648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166145+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:38:39.166145+0000","last_peered":"2024-09-10T11:38:39.166145+0000","last_clean":"2024-09-10T11:38:39.166145+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:38:39.166145+0000","last_undegraded":"2024-09-10T11:38:39.166145+0000","last_fullsized":"2024-09-10T11:38:39.166145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634591+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:38:37.634591+0000","last_peered":"2024-09-10T11:38:37.634591+0000","last_clean":"2024-09-10T11:38:37.634591+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:38:37.634591+0000","last_undegraded":"2024-09-10T11:38:37.634591+0000","last_fullsized":"2024-09-10T11:38:37.634591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636309+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:38:37.636309+0000","last_peered":"2024-09-10T11:38:37.636309+0000","last_clean":"2024-09-10T11:38:37.636309+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:38:37.636309+0000","last_undegraded":"2024-09-10T11:38:37.636309+0000","last_fullsized":"2024-09-10T11:38:37.636309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637255+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:38:37.637255+0000","last_peered":"2024-09-10T11:38:37.637255+0000","last_clean":"2024-09-10T11:38:37.637255+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:38:37.637255+0000","last_undegraded":"2024-09-10T11:38:37.637255+0000","last_fullsized":"2024-09-10T11:38:37.637255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165966+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:38:39.165966+0000","last_peered":"2024-09-10T11:38:39.165966+0000","last_clean":"2024-09-10T11:38:39.165966+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:38:39.165966+0000","last_undegraded":"2024-09-10T11:38:39.165966+0000","last_fullsized":"2024-09-10T11:38:39.165966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166663+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:38:39.166663+0000","last_peered":"2024-09-10T11:38:39.166663+0000","last_clean":"2024-09-10T11:38:39.166663+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:38:39.166663+0000","last_undegraded":"2024-09-10T11:38:39.166663+0000","last_fullsized":"2024-09-10T11:38:39.166663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638287+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:38:38.638287+0000","last_peered":"2024-09-10T11:38:38.638287+0000","last_clean":"2024-09-10T11:38:38.638287+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:38:38.638287+0000","last_undegraded":"2024-09-10T11:38:38.638287+0000","last_fullsized":"2024-09-10T11:38:38.638287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166357+0000","last_change":"2024-09-10T11:38:36.643946+0000","last_active":"2024-09-10T11:38:39.166357+0000","last_peered":"2024-09-10T11:38:39.166357+0000","last_clean":"2024-09-10T11:38:39.166357+0000","last_became_active":"2024-09-10T11:38:36.643648+0000","last_became_peered":"2024-09-10T11:38:36.643648+0000","last_unstale":"2024-09-10T11:38:39.166357+0000","last_undegraded":"2024-09-10T11:38:39.166357+0000","last_fullsized":"2024-09-10T11:38:39.166357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637479+0000","last_change":"2024-09-10T11:38:36.643116+0000","last_active":"2024-09-10T11:38:37.637479+0000","last_peered":"2024-09-10T11:38:37.637479+0000","last_clean":"2024-09-10T11:38:37.637479+0000","last_became_active":"2024-09-10T11:38:36.642805+0000","last_became_peered":"2024-09-10T11:38:36.642805+0000","last_unstale":"2024-09-10T11:38:37.637479+0000","last_undegraded":"2024-09-10T11:38:37.637479+0000","last_fullsized":"2024-09-10T11:38:37.637479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:53.917503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137290+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:38:39.137290+0000","last_peered":"2024-09-10T11:38:39.137290+0000","last_clean":"2024-09-10T11:38:39.137290+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:38:39.137290+0000","last_undegraded":"2024-09-10T11:38:39.137290+0000","last_fullsized":"2024-09-10T11:38:39.137290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636477+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:38:37.636477+0000","last_peered":"2024-09-10T11:38:37.636477+0000","last_clean":"2024-09-10T11:38:37.636477+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:38:37.636477+0000","last_undegraded":"2024-09-10T11:38:37.636477+0000","last_fullsized":"2024-09-10T11:38:37.636477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137797+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:38:39.137797+0000","last_peered":"2024-09-10T11:38:39.137797+0000","last_clean":"2024-09-10T11:38:39.137797+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:38:39.137797+0000","last_undegraded":"2024-09-10T11:38:39.137797+0000","last_fullsized":"2024-09-10T11:38:39.137797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638350+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:38:38.638350+0000","last_peered":"2024-09-10T11:38:38.638350+0000","last_clean":"2024-09-10T11:38:38.638350+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:38:38.638350+0000","last_undegraded":"2024-09-10T11:38:38.638350+0000","last_fullsized":"2024-09-10T11:38:38.638350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634892+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:38:37.634892+0000","last_peered":"2024-09-10T11:38:37.634892+0000","last_clean":"2024-09-10T11:38:37.634892+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:38:37.634892+0000","last_undegraded":"2024-09-10T11:38:37.634892+0000","last_fullsized":"2024-09-10T11:38:37.634892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137925+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:38:39.137925+0000","last_peered":"2024-09-10T11:38:39.137925+0000","last_clean":"2024-09-10T11:38:39.137925+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:38:39.137925+0000","last_undegraded":"2024-09-10T11:38:39.137925+0000","last_fullsized":"2024-09-10T11:38:39.137925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166405+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:38:39.166405+0000","last_peered":"2024-09-10T11:38:39.166405+0000","last_clean":"2024-09-10T11:38:39.166405+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:38:39.166405+0000","last_undegraded":"2024-09-10T11:38:39.166405+0000","last_fullsized":"2024-09-10T11:38:39.166405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637858+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:38:37.637858+0000","last_peered":"2024-09-10T11:38:37.637858+0000","last_clean":"2024-09-10T11:38:37.637858+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:38:37.637858+0000","last_undegraded":"2024-09-10T11:38:37.637858+0000","last_fullsized":"2024-09-10T11:38:37.637858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165985+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:38:39.165985+0000","last_peered":"2024-09-10T11:38:39.165985+0000","last_clean":"2024-09-10T11:38:39.165985+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:38:39.165985+0000","last_undegraded":"2024-09-10T11:38:39.165985+0000","last_fullsized":"2024-09-10T11:38:39.165985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638232+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:38:38.638232+0000","last_peered":"2024-09-10T11:38:38.638232+0000","last_clean":"2024-09-10T11:38:38.638232+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:38:38.638232+0000","last_undegraded":"2024-09-10T11:38:38.638232+0000","last_fullsized":"2024-09-10T11:38:38.638232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636281+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:38:37.636281+0000","last_peered":"2024-09-10T11:38:37.636281+0000","last_clean":"2024-09-10T11:38:37.636281+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:38:37.636281+0000","last_undegraded":"2024-09-10T11:38:37.636281+0000","last_fullsized":"2024-09-10T11:38:37.636281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137814+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:38:39.137814+0000","last_peered":"2024-09-10T11:38:39.137814+0000","last_clean":"2024-09-10T11:38:39.137814+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:38:39.137814+0000","last_undegraded":"2024-09-10T11:38:39.137814+0000","last_fullsized":"2024-09-10T11:38:39.137814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166662+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:38:39.166662+0000","last_peered":"2024-09-10T11:38:39.166662+0000","last_clean":"2024-09-10T11:38:39.166662+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:38:39.166662+0000","last_undegraded":"2024-09-10T11:38:39.166662+0000","last_fullsized":"2024-09-10T11:38:39.166662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637823+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:38:38.637823+0000","last_peered":"2024-09-10T11:38:38.637823+0000","last_clean":"2024-09-10T11:38:38.637823+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:38:38.637823+0000","last_undegraded":"2024-09-10T11:38:38.637823+0000","last_fullsized":"2024-09-10T11:38:38.637823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137316+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:38:39.137316+0000","last_peered":"2024-09-10T11:38:39.137316+0000","last_clean":"2024-09-10T11:38:39.137316+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:38:39.137316+0000","last_undegraded":"2024-09-10T11:38:39.137316+0000","last_fullsized":"2024-09-10T11:38:39.137316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137319+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:38:39.137319+0000","last_peered":"2024-09-10T11:38:39.137319+0000","last_clean":"2024-09-10T11:38:39.137319+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:38:39.137319+0000","last_undegraded":"2024-09-10T11:38:39.137319+0000","last_fullsized":"2024-09-10T11:38:39.137319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636420+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:38:37.636420+0000","last_peered":"2024-09-10T11:38:37.636420+0000","last_clean":"2024-09-10T11:38:37.636420+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:38:37.636420+0000","last_undegraded":"2024-09-10T11:38:37.636420+0000","last_fullsized":"2024-09-10T11:38:37.636420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634585+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:38:37.634585+0000","last_peered":"2024-09-10T11:38:37.634585+0000","last_clean":"2024-09-10T11:38:37.634585+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:38:37.634585+0000","last_undegraded":"2024-09-10T11:38:37.634585+0000","last_fullsized":"2024-09-10T11:38:37.634585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638124+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:38:38.638124+0000","last_peered":"2024-09-10T11:38:38.638124+0000","last_clean":"2024-09-10T11:38:38.638124+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:38:38.638124+0000","last_undegraded":"2024-09-10T11:38:38.638124+0000","last_fullsized":"2024-09-10T11:38:38.638124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636901+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:38:37.636901+0000","last_peered":"2024-09-10T11:38:37.636901+0000","last_clean":"2024-09-10T11:38:37.636901+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:38:37.636901+0000","last_undegraded":"2024-09-10T11:38:37.636901+0000","last_fullsized":"2024-09-10T11:38:37.636901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636860+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:38:37.636860+0000","last_peered":"2024-09-10T11:38:37.636860+0000","last_clean":"2024-09-10T11:38:37.636860+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:38:37.636860+0000","last_undegraded":"2024-09-10T11:38:37.636860+0000","last_fullsized":"2024-09-10T11:38:37.636860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166003+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:38:39.166003+0000","last_peered":"2024-09-10T11:38:39.166003+0000","last_clean":"2024-09-10T11:38:39.166003+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:38:39.166003+0000","last_undegraded":"2024-09-10T11:38:39.166003+0000","last_fullsized":"2024-09-10T11:38:39.166003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634824+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:38:37.634824+0000","last_peered":"2024-09-10T11:38:37.634824+0000","last_clean":"2024-09-10T11:38:37.634824+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:38:37.634824+0000","last_undegraded":"2024-09-10T11:38:37.634824+0000","last_fullsized":"2024-09-10T11:38:37.634824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637941+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:38:37.637941+0000","last_peered":"2024-09-10T11:38:37.637941+0000","last_clean":"2024-09-10T11:38:37.637941+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:38:37.637941+0000","last_undegraded":"2024-09-10T11:38:37.637941+0000","last_fullsized":"2024-09-10T11:38:37.637941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637984+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:38:38.637984+0000","last_peered":"2024-09-10T11:38:38.637984+0000","last_clean":"2024-09-10T11:38:38.637984+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:38:38.637984+0000","last_undegraded":"2024-09-10T11:38:38.637984+0000","last_fullsized":"2024-09-10T11:38:38.637984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166328+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:38:39.166328+0000","last_peered":"2024-09-10T11:38:39.166328+0000","last_clean":"2024-09-10T11:38:39.166328+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:38:39.166328+0000","last_undegraded":"2024-09-10T11:38:39.166328+0000","last_fullsized":"2024-09-10T11:38:39.166328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166556+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:38:39.166556+0000","last_peered":"2024-09-10T11:38:39.166556+0000","last_clean":"2024-09-10T11:38:39.166556+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:38:39.166556+0000","last_undegraded":"2024-09-10T11:38:39.166556+0000","last_fullsized":"2024-09-10T11:38:39.166556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166356+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:38:39.166356+0000","last_peered":"2024-09-10T11:38:39.166356+0000","last_clean":"2024-09-10T11:38:39.166356+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:38:39.166356+0000","last_undegraded":"2024-09-10T11:38:39.166356+0000","last_fullsized":"2024-09-10T11:38:39.166356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637603+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:38:37.637603+0000","last_peered":"2024-09-10T11:38:37.637603+0000","last_clean":"2024-09-10T11:38:37.637603+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:38:37.637603+0000","last_undegraded":"2024-09-10T11:38:37.637603+0000","last_fullsized":"2024-09-10T11:38:37.637603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166332+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:38:39.166332+0000","last_peered":"2024-09-10T11:38:39.166332+0000","last_clean":"2024-09-10T11:38:39.166332+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:38:39.166332+0000","last_undegraded":"2024-09-10T11:38:39.166332+0000","last_fullsized":"2024-09-10T11:38:39.166332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637806+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:38:38.637806+0000","last_peered":"2024-09-10T11:38:38.637806+0000","last_clean":"2024-09-10T11:38:38.637806+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:38:38.637806+0000","last_undegraded":"2024-09-10T11:38:38.637806+0000","last_fullsized":"2024-09-10T11:38:38.637806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638020+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:38:38.638020+0000","last_peered":"2024-09-10T11:38:38.638020+0000","last_clean":"2024-09-10T11:38:38.638020+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:38:38.638020+0000","last_undegraded":"2024-09-10T11:38:38.638020+0000","last_fullsized":"2024-09-10T11:38:38.638020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165609+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:38:39.165609+0000","last_peered":"2024-09-10T11:38:39.165609+0000","last_clean":"2024-09-10T11:38:39.165609+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:38:39.165609+0000","last_undegraded":"2024-09-10T11:38:39.165609+0000","last_fullsized":"2024-09-10T11:38:39.165609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166134+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:38:39.166134+0000","last_peered":"2024-09-10T11:38:39.166134+0000","last_clean":"2024-09-10T11:38:39.166134+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:38:39.166134+0000","last_undegraded":"2024-09-10T11:38:39.166134+0000","last_fullsized":"2024-09-10T11:38:39.166134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637534+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:38:37.637534+0000","last_peered":"2024-09-10T11:38:37.637534+0000","last_clean":"2024-09-10T11:38:37.637534+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:38:37.637534+0000","last_undegraded":"2024-09-10T11:38:37.637534+0000","last_fullsized":"2024-09-10T11:38:37.637534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166467+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:38:39.166467+0000","last_peered":"2024-09-10T11:38:39.166467+0000","last_clean":"2024-09-10T11:38:39.166467+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:38:39.166467+0000","last_undegraded":"2024-09-10T11:38:39.166467+0000","last_fullsized":"2024-09-10T11:38:39.166467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166064+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:38:39.166064+0000","last_peered":"2024-09-10T11:38:39.166064+0000","last_clean":"2024-09-10T11:38:39.166064+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:38:39.166064+0000","last_undegraded":"2024-09-10T11:38:39.166064+0000","last_fullsized":"2024-09-10T11:38:39.166064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166661+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:38:39.166661+0000","last_peered":"2024-09-10T11:38:39.166661+0000","last_clean":"2024-09-10T11:38:39.166661+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:38:39.166661+0000","last_undegraded":"2024-09-10T11:38:39.166661+0000","last_fullsized":"2024-09-10T11:38:39.166661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634985+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:38:37.634985+0000","last_peered":"2024-09-10T11:38:37.634985+0000","last_clean":"2024-09-10T11:38:37.634985+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:38:37.634985+0000","last_undegraded":"2024-09-10T11:38:37.634985+0000","last_fullsized":"2024-09-10T11:38:37.634985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636810+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:38:37.636810+0000","last_peered":"2024-09-10T11:38:37.636810+0000","last_clean":"2024-09-10T11:38:37.636810+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:38:37.636810+0000","last_undegraded":"2024-09-10T11:38:37.636810+0000","last_fullsized":"2024-09-10T11:38:37.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165675+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:38:39.165675+0000","last_peered":"2024-09-10T11:38:39.165675+0000","last_clean":"2024-09-10T11:38:39.165675+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:38:39.165675+0000","last_undegraded":"2024-09-10T11:38:39.165675+0000","last_fullsized":"2024-09-10T11:38:39.165675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166382+0000","last_change":"2024-09-10T11:38:36.653163+0000","last_active":"2024-09-10T11:38:39.166382+0000","last_peered":"2024-09-10T11:38:39.166382+0000","last_clean":"2024-09-10T11:38:39.166382+0000","last_became_active":"2024-09-10T11:38:36.652861+0000","last_became_peered":"2024-09-10T11:38:36.652861+0000","last_unstale":"2024-09-10T11:38:39.166382+0000","last_undegraded":"2024-09-10T11:38:39.166382+0000","last_fullsized":"2024-09-10T11:38:39.166382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165892+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:38:39.165892+0000","last_peered":"2024-09-10T11:38:39.165892+0000","last_clean":"2024-09-10T11:38:39.165892+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:38:39.165892+0000","last_undegraded":"2024-09-10T11:38:39.165892+0000","last_fullsized":"2024-09-10T11:38:39.165892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636247+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:38:37.636247+0000","last_peered":"2024-09-10T11:38:37.636247+0000","last_clean":"2024-09-10T11:38:37.636247+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:38:37.636247+0000","last_undegraded":"2024-09-10T11:38:37.636247+0000","last_fullsized":"2024-09-10T11:38:37.636247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137684+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:38:39.137684+0000","last_peered":"2024-09-10T11:38:39.137684+0000","last_clean":"2024-09-10T11:38:39.137684+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:38:39.137684+0000","last_undegraded":"2024-09-10T11:38:39.137684+0000","last_fullsized":"2024-09-10T11:38:39.137684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166230+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:38:39.166230+0000","last_peered":"2024-09-10T11:38:39.166230+0000","last_clean":"2024-09-10T11:38:39.166230+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:38:39.166230+0000","last_undegraded":"2024-09-10T11:38:39.166230+0000","last_fullsized":"2024-09-10T11:38:39.166230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165865+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:38:39.165865+0000","last_peered":"2024-09-10T11:38:39.165865+0000","last_clean":"2024-09-10T11:38:39.165865+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:38:39.165865+0000","last_undegraded":"2024-09-10T11:38:39.165865+0000","last_fullsized":"2024-09-10T11:38:39.165865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166086+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:38:39.166086+0000","last_peered":"2024-09-10T11:38:39.166086+0000","last_clean":"2024-09-10T11:38:39.166086+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:38:39.166086+0000","last_undegraded":"2024-09-10T11:38:39.166086+0000","last_fullsized":"2024-09-10T11:38:39.166086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634619+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:38:37.634619+0000","last_peered":"2024-09-10T11:38:37.634619+0000","last_clean":"2024-09-10T11:38:37.634619+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:38:37.634619+0000","last_undegraded":"2024-09-10T11:38:37.634619+0000","last_fullsized":"2024-09-10T11:38:37.634619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637700+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:38:37.637700+0000","last_peered":"2024-09-10T11:38:37.637700+0000","last_clean":"2024-09-10T11:38:37.637700+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:38:37.637700+0000","last_undegraded":"2024-09-10T11:38:37.637700+0000","last_fullsized":"2024-09-10T11:38:37.637700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637363+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:38:37.637363+0000","last_peered":"2024-09-10T11:38:37.637363+0000","last_clean":"2024-09-10T11:38:37.637363+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:38:37.637363+0000","last_undegraded":"2024-09-10T11:38:37.637363+0000","last_fullsized":"2024-09-10T11:38:37.637363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634761+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:38:37.634761+0000","last_peered":"2024-09-10T11:38:37.634761+0000","last_clean":"2024-09-10T11:38:37.634761+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:38:37.634761+0000","last_undegraded":"2024-09-10T11:38:37.634761+0000","last_fullsized":"2024-09-10T11:38:37.634761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636997+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:38:37.636997+0000","last_peered":"2024-09-10T11:38:37.636997+0000","last_clean":"2024-09-10T11:38:37.636997+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:38:37.636997+0000","last_undegraded":"2024-09-10T11:38:37.636997+0000","last_fullsized":"2024-09-10T11:38:37.636997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166586+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:38:39.166586+0000","last_peered":"2024-09-10T11:38:39.166586+0000","last_clean":"2024-09-10T11:38:39.166586+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:38:39.166586+0000","last_undegraded":"2024-09-10T11:38:39.166586+0000","last_fullsized":"2024-09-10T11:38:39.166586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634718+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:38:37.634718+0000","last_peered":"2024-09-10T11:38:37.634718+0000","last_clean":"2024-09-10T11:38:37.634718+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:38:37.634718+0000","last_undegraded":"2024-09-10T11:38:37.634718+0000","last_fullsized":"2024-09-10T11:38:37.634718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.637077+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:38:38.637077+0000","last_peered":"2024-09-10T11:38:38.637077+0000","last_clean":"2024-09-10T11:38:38.637077+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:38:38.637077+0000","last_undegraded":"2024-09-10T11:38:38.637077+0000","last_fullsized":"2024-09-10T11:38:38.637077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137549+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:38:39.137549+0000","last_peered":"2024-09-10T11:38:39.137549+0000","last_clean":"2024-09-10T11:38:39.137549+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:38:39.137549+0000","last_undegraded":"2024-09-10T11:38:39.137549+0000","last_fullsized":"2024-09-10T11:38:39.137549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638190+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:38:38.638190+0000","last_peered":"2024-09-10T11:38:38.638190+0000","last_clean":"2024-09-10T11:38:38.638190+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:38:38.638190+0000","last_undegraded":"2024-09-10T11:38:38.638190+0000","last_fullsized":"2024-09-10T11:38:38.638190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166762+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:38:39.166762+0000","last_peered":"2024-09-10T11:38:39.166762+0000","last_clean":"2024-09-10T11:38:39.166762+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:38:39.166762+0000","last_undegraded":"2024-09-10T11:38:39.166762+0000","last_fullsized":"2024-09-10T11:38:39.166762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165790+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:38:39.165790+0000","last_peered":"2024-09-10T11:38:39.165790+0000","last_clean":"2024-09-10T11:38:39.165790+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:38:39.165790+0000","last_undegraded":"2024-09-10T11:38:39.165790+0000","last_fullsized":"2024-09-10T11:38:39.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636602+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:38:37.636602+0000","last_peered":"2024-09-10T11:38:37.636602+0000","last_clean":"2024-09-10T11:38:37.636602+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:38:37.636602+0000","last_undegraded":"2024-09-10T11:38:37.636602+0000","last_fullsized":"2024-09-10T11:38:37.636602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634705+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:38:37.634705+0000","last_peered":"2024-09-10T11:38:37.634705+0000","last_clean":"2024-09-10T11:38:37.634705+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:38:37.634705+0000","last_undegraded":"2024-09-10T11:38:37.634705+0000","last_fullsized":"2024-09-10T11:38:37.634705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137451+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:38:39.137451+0000","last_peered":"2024-09-10T11:38:39.137451+0000","last_clean":"2024-09-10T11:38:39.137451+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:38:39.137451+0000","last_undegraded":"2024-09-10T11:38:39.137451+0000","last_fullsized":"2024-09-10T11:38:39.137451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.634609+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:38:37.634609+0000","last_peered":"2024-09-10T11:38:37.634609+0000","last_clean":"2024-09-10T11:38:37.634609+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:38:37.634609+0000","last_undegraded":"2024-09-10T11:38:37.634609+0000","last_fullsized":"2024-09-10T11:38:37.634609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137860+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:38:39.137860+0000","last_peered":"2024-09-10T11:38:39.137860+0000","last_clean":"2024-09-10T11:38:39.137860+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:38:39.137860+0000","last_undegraded":"2024-09-10T11:38:39.137860+0000","last_fullsized":"2024-09-10T11:38:39.137860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166497+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:38:39.166497+0000","last_peered":"2024-09-10T11:38:39.166497+0000","last_clean":"2024-09-10T11:38:39.166497+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:38:39.166497+0000","last_undegraded":"2024-09-10T11:38:39.166497+0000","last_fullsized":"2024-09-10T11:38:39.166497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:38.638081+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:38:38.638081+0000","last_peered":"2024-09-10T11:38:38.638081+0000","last_clean":"2024-09-10T11:38:38.638081+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:38:38.638081+0000","last_undegraded":"2024-09-10T11:38:38.638081+0000","last_fullsized":"2024-09-10T11:38:38.638081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.637039+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:38:37.637039+0000","last_peered":"2024-09-10T11:38:37.637039+0000","last_clean":"2024-09-10T11:38:37.637039+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:38:37.637039+0000","last_undegraded":"2024-09-10T11:38:37.637039+0000","last_fullsized":"2024-09-10T11:38:37.637039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166074+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:38:39.166074+0000","last_peered":"2024-09-10T11:38:39.166074+0000","last_clean":"2024-09-10T11:38:39.166074+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:38:39.166074+0000","last_undegraded":"2024-09-10T11:38:39.166074+0000","last_fullsized":"2024-09-10T11:38:39.166074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:37.636640+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:38:37.636640+0000","last_peered":"2024-09-10T11:38:37.636640+0000","last_clean":"2024-09-10T11:38:37.636640+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:38:37.636640+0000","last_undegraded":"2024-09-10T11:38:37.636640+0000","last_fullsized":"2024-09-10T11:38:37.636640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166462+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:38:39.166462+0000","last_peered":"2024-09-10T11:38:39.166462+0000","last_clean":"2024-09-10T11:38:39.166462+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:38:39.166462+0000","last_undegraded":"2024-09-10T11:38:39.166462+0000","last_fullsized":"2024-09-10T11:38:39.166462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.165811+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:38:39.165811+0000","last_peered":"2024-09-10T11:38:39.165811+0000","last_clean":"2024-09-10T11:38:39.165811+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:38:39.165811+0000","last_undegraded":"2024-09-10T11:38:39.165811+0000","last_fullsized":"2024-09-10T11:38:39.165811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.137626+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:38:39.137626+0000","last_peered":"2024-09-10T11:38:39.137626+0000","last_clean":"2024-09-10T11:38:39.137626+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:38:39.137626+0000","last_undegraded":"2024-09-10T11:38:39.137626+0000","last_fullsized":"2024-09-10T11:38:39.137626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.138032+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:38:39.138032+0000","last_peered":"2024-09-10T11:38:39.138032+0000","last_clean":"2024-09-10T11:38:39.138032+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:38:39.138032+0000","last_undegraded":"2024-09-10T11:38:39.138032+0000","last_fullsized":"2024-09-10T11:38:39.138032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T11:38:39.166800+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:38:39.166800+0000","last_peered":"2024-09-10T11:38:39.166800+0000","last_clean":"2024-09-10T11:38:39.166800+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:38:39.166800+0000","last_undegraded":"2024-09-10T11:38:39.166800+0000","last_fullsized":"2024-09-10T11:38:39.166800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:38:48.703 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T11:38:48.704 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T11:38:48.704 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T11:38:48.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:38:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 -- 172.21.15.57:0/613241133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 msgr2=0x7fc98806cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 --2- 172.21.15.57:0/613241133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc98806cb90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9880cc3a0 tx=0x7fc97c02a530 comp rx=0 tx=0).stop 2024-09-10T11:38:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 -- 172.21.15.57:0/613241133 shutdown_connections 2024-09-10T11:38:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 --2- 172.21.15.57:0/613241133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc98806cb90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 -- 172.21.15.57:0/613241133 >> 172.21.15.57:0/613241133 conn(0x7fc9880b1780 msgr2=0x7fc9880b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 -- 172.21.15.57:0/613241133 shutdown_connections 2024-09-10T11:38:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.844+0000 7fc990594640 1 -- 172.21.15.57:0/613241133 wait complete. 2024-09-10T11:38:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.845+0000 7fc990594640 1 Processor -- start 2024-09-10T11:38:48.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.845+0000 7fc990594640 1 -- start start 2024-09-10T11:38:48.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc990594640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc98806d0d0 0x7fc9881f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc990594640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc988072650 0x7fc988156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc990594640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc9880a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc990594640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc988072bb0 con 0x7fc98815bab0 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc990594640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc988072a30 con 0x7fc98806d0d0 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc990594640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc9880cdf60 con 0x7fc988072650 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc9880a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc9880a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47008/0 (socket says 172.21.15.57:47008) 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 -- 172.21.15.57:0/703642353 learned_addr learned my addr 172.21.15.57:0/703642353 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98e330640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc98806d0d0 0x7fc9881f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98db2f640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc988072650 0x7fc988156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 -- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc988072650 msgr2=0x7fc988156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc988072650 0x7fc988156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 -- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc98806d0d0 msgr2=0x7fc9881f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc98806d0d0 0x7fc9881f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98eb31640 1 -- 172.21.15.57:0/703642353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9881f2160 con 0x7fc98815bab0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.846+0000 7fc98e330640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc98806d0d0 0x7fc9881f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.847+0000 7fc98eb31640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc9880a9fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c7a0 tx=0x7fc98000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.847+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980003b70 con 0x7fc98815bab0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.847+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc980003d10 con 0x7fc98815bab0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.847+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc988156f60 con 0x7fc98815bab0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.847+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98000aab0 con 0x7fc98815bab0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.847+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc988157520 con 0x7fc98815bab0 2024-09-10T11:38:48.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.848+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9880ce430 con 0x7fc98815bab0 2024-09-10T11:38:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.848+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fc98000ac50 con 0x7fc98815bab0 2024-09-10T11:38:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.849+0000 7fc97affd640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc96c0750a0 0x7fc96c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.849+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9800961b0 con 0x7fc98815bab0 2024-09-10T11:38:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.849+0000 7fc98e330640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc96c0750a0 0x7fc96c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.850+0000 7fc98e330640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc96c0750a0 0x7fc96c077560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9880cf9f0 tx=0x7fc984009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:48.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:48.853+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fc980060510 con 0x7fc98815bab0 2024-09-10T11:38:49.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.048+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc9880d00d0 con 0x7fc98815bab0 2024-09-10T11:38:49.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.048+0000 7fc97affd640 1 -- 172.21.15.57:0/703642353 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc98005fe10 con 0x7fc98815bab0 2024-09-10T11:38:49.050 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:49.050 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:38:49.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc96c0750a0 msgr2=0x7fc96c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:49.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc96c0750a0 0x7fc96c077560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9880cf9f0 tx=0x7fc984009040 comp rx=0 tx=0).stop 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 msgr2=0x7fc9880a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc9880a9fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc98000c7a0 tx=0x7fc98000cc60 comp rx=0 tx=0).stop 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 shutdown_connections 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc96c0750a0 0x7fc96c077560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc98815bab0 0x7fc9880a9fc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc988072650 0x7fc988156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 --2- 172.21.15.57:0/703642353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc98806d0d0 0x7fc9881f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 >> 172.21.15.57:0/703642353 conn(0x7fc9880b1780 msgr2=0x7fc9880cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 shutdown_connections 2024-09-10T11:38:49.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:49.050+0000 7fc990594640 1 -- 172.21.15.57:0/703642353 wait complete. 2024-09-10T11:38:52.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:38:52.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 -- 172.21.15.57:0/2600027416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 msgr2=0x7f07fc0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:52.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2600027416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 0x7f07fc0b1c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005fd0 tx=0x7f07f802a5d0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 -- 172.21.15.57:0/2600027416 shutdown_connections 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2600027416 >> v2:172.21.15.154:3300/0 conn(0x7f07fc0b2160 0x7f07fc0af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2600027416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 0x7f07fc0b1c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 -- 172.21.15.57:0/2600027416 >> 172.21.15.57:0/2600027416 conn(0x7f07fc0ccc20 msgr2=0x7f07fc0cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 -- 172.21.15.57:0/2600027416 shutdown_connections 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.180+0000 7f0803a8e640 1 -- 172.21.15.57:0/2600027416 wait complete. 2024-09-10T11:38:52.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.181+0000 7f0803a8e640 1 Processor -- start 2024-09-10T11:38:52.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 -- start start 2024-09-10T11:38:52.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 0x7f07fc15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:52.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 0x7f07fc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:52.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0b2160 0x7f07fc159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc06f080 con 0x7f07fc0af590 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc06f200 con 0x7f07fc0b2160 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0803a8e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc06f380 con 0x7f07fc0aebc0 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0801029640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 0x7f07fc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.182+0000 7f0801029640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 0x7f07fc159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60976/0 (socket says 172.21.15.57:60976) 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 -- 172.21.15.57:0/2251679261 learned_addr learned my addr 172.21.15.57:0/2251679261 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f080202b640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0b2160 0x7f07fc159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f080182a640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 0x7f07fc15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 -- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 msgr2=0x7f07fc15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 0x7f07fc15ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 -- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0b2160 msgr2=0x7f07fc159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:52.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0b2160 0x7f07fc159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 -- 172.21.15.57:0/2251679261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc09af60 con 0x7f07fc0af590 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0801029640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 0x7f07fc159330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f07f000e910 tx=0x7f07f000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f000cd80 con 0x7f07fc0af590 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07f0010430 con 0x7f07fc0af590 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc09b240 con 0x7f07fc0af590 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0010860 con 0x7f07fc0af590 2024-09-10T11:38:52.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.183+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc09b800 con 0x7f07fc0af590 2024-09-10T11:38:52.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.184+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc0b1c20 con 0x7f07fc0af590 2024-09-10T11:38:52.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.185+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f07f0010a00 con 0x7f07fc0af590 2024-09-10T11:38:52.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.185+0000 7f07ee7fc640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07e00750a0 0x7f07e0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:52.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.186+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07f0096db0 con 0x7f07fc0af590 2024-09-10T11:38:52.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.186+0000 7f080182a640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07e00750a0 0x7f07e0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:52.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.186+0000 7f080182a640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07e00750a0 0x7f07e0077560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005fd0 tx=0x7f07f8004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:52.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.189+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f07f0060a30 con 0x7f07fc0af590 2024-09-10T11:38:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.390+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f07fc0cd000 con 0x7f07fc0af590 2024-09-10T11:38:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.390+0000 7f07ee7fc640 1 -- 172.21.15.57:0/2251679261 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f07f00651f0 con 0x7f07fc0af590 2024-09-10T11:38:52.391 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:52.391 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:38:52.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07e00750a0 msgr2=0x7f07e0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:52.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07e00750a0 0x7f07e0077560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005fd0 tx=0x7f07f8004730 comp rx=0 tx=0).stop 2024-09-10T11:38:52.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 msgr2=0x7f07fc159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:52.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 0x7f07fc159330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f07f000e910 tx=0x7f07f000edd0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 shutdown_connections 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f07e00750a0 0x7f07e0077560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0b2160 0x7f07fc159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07fc0af590 0x7f07fc159330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 --2- 172.21.15.57:0/2251679261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07fc0aebc0 0x7f07fc15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 >> 172.21.15.57:0/2251679261 conn(0x7f07fc0ccc20 msgr2=0x7f07fc06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 shutdown_connections 2024-09-10T11:38:52.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:52.392+0000 7f0803a8e640 1 -- 172.21.15.57:0/2251679261 wait complete. 2024-09-10T11:38:55.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:38:55.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26eca0f640 1 -- 172.21.15.57:0/3784804558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26d4003a50 msgr2=0x7f26d4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26eca0f640 1 --2- 172.21.15.57:0/3784804558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26d4003a50 0x7f26d4003e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009b50 tx=0x7f26d4005830 comp rx=0 tx=0).stop 2024-09-10T11:38:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26e6d9d640 1 -- 172.21.15.57:0/3784804558 reap_dead start 2024-09-10T11:38:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26eca0f640 1 -- 172.21.15.57:0/3784804558 shutdown_connections 2024-09-10T11:38:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26eca0f640 1 -- 172.21.15.57:0/3784804558 >> 172.21.15.57:0/3784804558 conn(0x7f26e80b2620 msgr2=0x7f26e80b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26eca0f640 1 -- 172.21.15.57:0/3784804558 shutdown_connections 2024-09-10T11:38:55.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.522+0000 7f26eca0f640 1 -- 172.21.15.57:0/3784804558 wait complete. 2024-09-10T11:38:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.524+0000 7f26eca0f640 1 Processor -- start 2024-09-10T11:38:55.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.524+0000 7f26eca0f640 1 -- start start 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d4003a50 0x7f26e814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 0x7f26e8140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e81f5ca0 0x7f26e81f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f26e80cff30 con 0x7f26e813ffb0 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26e80cfdb0 con 0x7f26e81f5ca0 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26e806c8d0 con 0x7f26d4003a50 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 0x7f26e8140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 0x7f26e8140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60984/0 (socket says 172.21.15.57:60984) 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 -- 172.21.15.57:0/340892618 learned_addr learned my addr 172.21.15.57:0/340892618 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 -- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d4003a50 msgr2=0x7f26e814ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e659c640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d4003a50 0x7f26e814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e6d9d640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e81f5ca0 0x7f26e81f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:55.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d4003a50 0x7f26e814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 -- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e81f5ca0 msgr2=0x7f26e81f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e81f5ca0 0x7f26e81f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 -- 172.21.15.57:0/340892618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e8140970 con 0x7f26e813ffb0 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e6d9d640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e81f5ca0 0x7f26e81f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26e5d9b640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 0x7f26e8140430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26d0011ae0 tx=0x7f26d0009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d001e070 con 0x7f26e813ffb0 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d000fe70 con 0x7f26e813ffb0 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e814d270 con 0x7f26e813ffb0 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0004290 con 0x7f26e813ffb0 2024-09-10T11:38:55.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.525+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e814d830 con 0x7f26e813ffb0 2024-09-10T11:38:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.527+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e815cac0 con 0x7f26e813ffb0 2024-09-10T11:38:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.527+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f26d0021070 con 0x7f26e813ffb0 2024-09-10T11:38:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.527+0000 7f26deffd640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26c80750a0 0x7f26c8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.528+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f26d0096d30 con 0x7f26e813ffb0 2024-09-10T11:38:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.528+0000 7f26e659c640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26c80750a0 0x7f26c8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:55.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.528+0000 7f26e659c640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26c80750a0 0x7f26c8077560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f26d8035000 tx=0x7f26d802d040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:55.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.531+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f26d009b070 con 0x7f26e813ffb0 2024-09-10T11:38:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.731+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26e806f660 con 0x7f26e813ffb0 2024-09-10T11:38:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.732+0000 7f26deffd640 1 -- 172.21.15.57:0/340892618 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f26d0060b90 con 0x7f26e813ffb0 2024-09-10T11:38:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:55.733 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:38:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26c80750a0 msgr2=0x7f26c8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26c80750a0 0x7f26c8077560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f26d8035000 tx=0x7f26d802d040 comp rx=0 tx=0).stop 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 msgr2=0x7f26e8140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 0x7f26e8140430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f26d0011ae0 tx=0x7f26d0009e90 comp rx=0 tx=0).stop 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 shutdown_connections 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26c80750a0 0x7f26c8077560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e81f5ca0 0x7f26e81f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26e813ffb0 0x7f26e8140430 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 --2- 172.21.15.57:0/340892618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d4003a50 0x7f26e814ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 >> 172.21.15.57:0/340892618 conn(0x7f26e80b2620 msgr2=0x7f26e815bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 shutdown_connections 2024-09-10T11:38:55.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:55.733+0000 7f26eca0f640 1 -- 172.21.15.57:0/340892618 wait complete. 2024-09-10T11:38:58.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:38:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 -- 172.21.15.57:0/638307697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 msgr2=0x7f5420070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:58.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 --2- 172.21.15.57:0/638307697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 0x7f5420070a80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5408005fd0 tx=0x7f540802a4b0 comp rx=0 tx=0).stop 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 -- 172.21.15.57:0/638307697 shutdown_connections 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 --2- 172.21.15.57:0/638307697 >> v2:172.21.15.154:3300/0 conn(0x7f5420070fc0 0x7f542015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 --2- 172.21.15.57:0/638307697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 0x7f5420070a80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 -- 172.21.15.57:0/638307697 >> 172.21.15.57:0/638307697 conn(0x7f54200d1bf0 msgr2=0x7f54200d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 -- 172.21.15.57:0/638307697 shutdown_connections 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.863+0000 7f5425816640 1 -- 172.21.15.57:0/638307697 wait complete. 2024-09-10T11:38:58.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.864+0000 7f5425816640 1 Processor -- start 2024-09-10T11:38:58.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 -- start start 2024-09-10T11:38:58.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 0x7f54200c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5420070fc0 0x7f54200b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 0x7f54200af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f54200719a0 con 0x7f54200706a0 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5420071820 con 0x7f5420070fc0 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.865+0000 7f5425816640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5420071d70 con 0x7f54200721a0 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 0x7f54200c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 0x7f54200c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60996/0 (socket says 172.21.15.57:60996) 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 -- 172.21.15.57:0/1111586318 learned_addr learned my addr 172.21.15.57:0/1111586318 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541e7fc640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5420070fc0 0x7f54200b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541f7fe640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 0x7f54200af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 -- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 msgr2=0x7f54200af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:58.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 0x7f54200af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 -- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5420070fc0 msgr2=0x7f54200b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5420070fc0 0x7f54200b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 -- 172.21.15.57:0/1111586318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542014b840 con 0x7f54200706a0 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f541effd640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 0x7f54200c7380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f541000c450 tx=0x7f541000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410017070 con 0x7f54200706a0 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54100053c0 con 0x7f54200706a0 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410003850 con 0x7f54200706a0 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54200c68a0 con 0x7f54200706a0 2024-09-10T11:38:58.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.866+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54200c6e60 con 0x7f54200706a0 2024-09-10T11:38:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.867+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542015fad0 con 0x7f54200706a0 2024-09-10T11:38:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.868+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f541001a070 con 0x7f54200706a0 2024-09-10T11:38:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.869+0000 7f5417fff640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f54000750a0 0x7f5400077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:38:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.869+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5410095580 con 0x7f54200706a0 2024-09-10T11:38:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.869+0000 7f541e7fc640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f54000750a0 0x7f5400077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:38:58.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.869+0000 7f541e7fc640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f54000750a0 0x7f5400077560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5408033000 tx=0x7f5408004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:38:58.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:58.873+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f541005f320 con 0x7f54200706a0 2024-09-10T11:38:59.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.071+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f54200cbad0 con 0x7f54200706a0 2024-09-10T11:38:59.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.071+0000 7f5417fff640 1 -- 172.21.15.57:0/1111586318 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f5410063ae0 con 0x7f54200706a0 2024-09-10T11:38:59.072 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:38:59.072 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:38:59.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f54000750a0 msgr2=0x7f5400077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:59.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f54000750a0 0x7f5400077560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5408033000 tx=0x7f5408004730 comp rx=0 tx=0).stop 2024-09-10T11:38:59.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 msgr2=0x7f54200c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 0x7f54200c7380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f541000c450 tx=0x7f541000c850 comp rx=0 tx=0).stop 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 shutdown_connections 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f54000750a0 0x7f5400077560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54200721a0 0x7f54200af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5420070fc0 0x7f54200b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 --2- 172.21.15.57:0/1111586318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54200706a0 0x7f54200c7380 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 >> 172.21.15.57:0/1111586318 conn(0x7f54200d1bf0 msgr2=0x7f54200c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 shutdown_connections 2024-09-10T11:38:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:38:59.073+0000 7f5425816640 1 -- 172.21.15.57:0/1111586318 wait complete. 2024-09-10T11:39:00.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:39:00.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:39:02.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 -- 172.21.15.57:0/91199454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7100d48e0 msgr2=0x7fb7100cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 --2- 172.21.15.57:0/91199454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7100d48e0 0x7fb7100cf1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb704005fd0 tx=0x7fb70402a5d0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 -- 172.21.15.57:0/91199454 shutdown_connections 2024-09-10T11:39:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 --2- 172.21.15.57:0/91199454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7100cf730 0x7fb7101601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 --2- 172.21.15.57:0/91199454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7100d48e0 0x7fb7100cf1f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 -- 172.21.15.57:0/91199454 >> 172.21.15.57:0/91199454 conn(0x7fb7100d3dc0 msgr2=0x7fb7100d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 -- 172.21.15.57:0/91199454 shutdown_connections 2024-09-10T11:39:02.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.201+0000 7fb7173ab640 1 -- 172.21.15.57:0/91199454 wait complete. 2024-09-10T11:39:02.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.203+0000 7fb7173ab640 1 Processor -- start 2024-09-10T11:39:02.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.203+0000 7fb7173ab640 1 -- start start 2024-09-10T11:39:02.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7100cf730 0x7fb7100b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:02.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7100d48e0 0x7fb71015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:02.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 0x7fb7101f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:02.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb710160be0 con 0x7fb7101f4c00 2024-09-10T11:39:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb710160a60 con 0x7fb7100cf730 2024-09-10T11:39:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb710160d60 con 0x7fb7100d48e0 2024-09-10T11:39:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 0x7fb7101f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 0x7fb7101f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33848/0 (socket says 172.21.15.57:33848) 2024-09-10T11:39:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 -- 172.21.15.57:0/574726518 learned_addr learned my addr 172.21.15.57:0/574726518 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715147640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7100cf730 0x7fb7100b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:02.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb714946640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7100d48e0 0x7fb71015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:02.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 -- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7100d48e0 msgr2=0x7fb71015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:02.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7100d48e0 0x7fb71015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 -- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7100cf730 msgr2=0x7fb7100b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:02.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7100cf730 0x7fb7100b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 -- 172.21.15.57:0/574726518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7101f56f0 con 0x7fb7101f4c00 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb715948640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 0x7fb7101f5050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb70800d750 tx=0x7fb70800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb708017070 con 0x7fb7101f4c00 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb708009cc0 con 0x7fb7101f4c00 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70800de60 con 0x7fb7101f4c00 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.204+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7101f59d0 con 0x7fb7101f4c00 2024-09-10T11:39:02.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.205+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7100b6360 con 0x7fb7101f4c00 2024-09-10T11:39:02.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.206+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7101f5c10 con 0x7fb7101f4c00 2024-09-10T11:39:02.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.206+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb708005280 con 0x7fb7101f4c00 2024-09-10T11:39:02.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.207+0000 7fb70dffb640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb6fc0750a0 0x7fb6fc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:02.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.207+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb7080963d0 con 0x7fb7101f4c00 2024-09-10T11:39:02.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.207+0000 7fb715147640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb6fc0750a0 0x7fb6fc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:02.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.207+0000 7fb715147640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb6fc0750a0 0x7fb6fc077560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb700001e20 tx=0x7fb700009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:02.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.211+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb7101f5c10 con 0x7fb7101f4c00 2024-09-10T11:39:02.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.408+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb7101612f0 con 0x7fb7101f4c00 2024-09-10T11:39:02.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.408+0000 7fb70dffb640 1 -- 172.21.15.57:0/574726518 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb7080600e0 con 0x7fb7101f4c00 2024-09-10T11:39:02.410 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:02.410 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb6fc0750a0 msgr2=0x7fb6fc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb6fc0750a0 0x7fb6fc077560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb700001e20 tx=0x7fb700009040 comp rx=0 tx=0).stop 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 msgr2=0x7fb7101f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 0x7fb7101f5050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb70800d750 tx=0x7fb70800dc10 comp rx=0 tx=0).stop 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 shutdown_connections 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb6fc0750a0 0x7fb6fc077560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7101f4c00 0x7fb7101f5050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7100d48e0 0x7fb71015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 --2- 172.21.15.57:0/574726518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7100cf730 0x7fb7100b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.410+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 >> 172.21.15.57:0/574726518 conn(0x7fb7100d3dc0 msgr2=0x7fb7100b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:02.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.411+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 shutdown_connections 2024-09-10T11:39:02.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:02.411+0000 7fb7173ab640 1 -- 172.21.15.57:0/574726518 wait complete. 2024-09-10T11:39:05.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.539+0000 7f9707f5d640 1 -- 172.21.15.57:0/1828061573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97000cf730 msgr2=0x7f97001601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.539+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1828061573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97000cf730 0x7f97001601a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f96f8005fd0 tx=0x7f96f802aa90 comp rx=0 tx=0).stop 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.540+0000 7f9707f5d640 1 -- 172.21.15.57:0/1828061573 shutdown_connections 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.540+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1828061573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97000d48e0 0x7f97000cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.540+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1828061573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97000cf730 0x7f97001601a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.540+0000 7f9707f5d640 1 -- 172.21.15.57:0/1828061573 >> 172.21.15.57:0/1828061573 conn(0x7f97000d3dc0 msgr2=0x7f97000d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.540+0000 7f9707f5d640 1 -- 172.21.15.57:0/1828061573 shutdown_connections 2024-09-10T11:39:05.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.540+0000 7f9707f5d640 1 -- 172.21.15.57:0/1828061573 wait complete. 2024-09-10T11:39:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.541+0000 7f9707f5d640 1 Processor -- start 2024-09-10T11:39:05.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.541+0000 7f9707f5d640 1 -- start start 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9707f5d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97000cf730 0x7f97000cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9707f5d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97000d48e0 0x7f97001f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9707f5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 0x7f97000c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9707f5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9700160c60 con 0x7f97001f5220 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9707f5d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9700160ae0 con 0x7f97000cf730 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9707f5d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9700160de0 con 0x7f97000d48e0 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 0x7f97000c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 0x7f97000c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33870/0 (socket says 172.21.15.57:33870) 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 -- 172.21.15.57:0/1127309566 learned_addr learned my addr 172.21.15.57:0/1127309566 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:05.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97054f8640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97000d48e0 0x7f97001f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f9705cf9640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97000cf730 0x7f97000cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 -- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97000d48e0 msgr2=0x7f97001f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97000d48e0 0x7f97001f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 -- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97000cf730 msgr2=0x7f97000cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97000cf730 0x7f97000cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 -- 172.21.15.57:0/1127309566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97000ccd30 con 0x7f97001f5220 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f97064fa640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 0x7f97000c89e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006010 tx=0x7f96f8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.542+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8046070 con 0x7f97001f5220 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.543+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f8003e50 con 0x7f97001f5220 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.543+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f80044b0 con 0x7f97001f5220 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.543+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97000cd010 con 0x7f97001f5220 2024-09-10T11:39:05.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.543+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97000cd5d0 con 0x7f97001f5220 2024-09-10T11:39:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.544+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9700161370 con 0x7f97001f5220 2024-09-10T11:39:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.544+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f96f8049070 con 0x7f97001f5220 2024-09-10T11:39:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.545+0000 7f96f67fc640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f96e40750a0 0x7f96e4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.545+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96f80b7140 con 0x7f97001f5220 2024-09-10T11:39:05.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.545+0000 7f9705cf9640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f96e40750a0 0x7f96e4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:05.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.545+0000 7f9705cf9640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f96e40750a0 0x7f96e4077560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000f60 tx=0x7f96fc009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:05.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.549+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f96f8032030 con 0x7f97001f5220 2024-09-10T11:39:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.745+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f97000b3300 con 0x7f97001f5220 2024-09-10T11:39:05.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.745+0000 7f96f67fc640 1 -- 172.21.15.57:0/1127309566 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f96f8080e50 con 0x7f97001f5220 2024-09-10T11:39:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:05.748 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f96e40750a0 msgr2=0x7f96e4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f96e40750a0 0x7f96e4077560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f96fc000f60 tx=0x7f96fc009040 comp rx=0 tx=0).stop 2024-09-10T11:39:05.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 msgr2=0x7f97000c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 0x7f97000c89e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f96f8006010 tx=0x7f96f8003ce0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 shutdown_connections 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f96e40750a0 0x7f96e4077560 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97001f5220 0x7f97000c89e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97000d48e0 0x7f97001f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 --2- 172.21.15.57:0/1127309566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97000cf730 0x7f97000cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 >> 172.21.15.57:0/1127309566 conn(0x7f97000d3dc0 msgr2=0x7f97000b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 shutdown_connections 2024-09-10T11:39:05.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:05.747+0000 7f9707f5d640 1 -- 172.21.15.57:0/1127309566 wait complete. 2024-09-10T11:39:08.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:08.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 -- 172.21.15.57:0/285264599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c8152e30 msgr2=0x7f60c80b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:08.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 --2- 172.21.15.57:0/285264599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c8152e30 0x7f60c80b45a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009860 tx=0x7f60c002a510 comp rx=0 tx=0).stop 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 -- 172.21.15.57:0/285264599 shutdown_connections 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 --2- 172.21.15.57:0/285264599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c8152e30 0x7f60c80b45a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 -- 172.21.15.57:0/285264599 >> 172.21.15.57:0/285264599 conn(0x7f60c80b1780 msgr2=0x7f60c80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 -- 172.21.15.57:0/285264599 shutdown_connections 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.876+0000 7f60cd990640 1 -- 172.21.15.57:0/285264599 wait complete. 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.878+0000 7f60cd990640 1 Processor -- start 2024-09-10T11:39:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.878+0000 7f60cd990640 1 -- start start 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c806cb10 0x7f60c814f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c80cccf0 0x7f60c8150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 0x7f60c8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f60c80ce490 con 0x7f60c8152e30 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60c80ce310 con 0x7f60c80cccf0 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60c806cf50 con 0x7f60c806cb10 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 0x7f60c8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 0x7f60c8153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33886/0 (socket says 172.21.15.57:33886) 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 -- 172.21.15.57:0/940134103 learned_addr learned my addr 172.21.15.57:0/940134103 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c6ffd640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c806cb10 0x7f60c814f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c67fc640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c80cccf0 0x7f60c8150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 -- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c806cb10 msgr2=0x7f60c814f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c806cb10 0x7f60c814f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 -- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c80cccf0 msgr2=0x7f60c8150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c80cccf0 0x7f60c8150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 -- 172.21.15.57:0/940134103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c81f46e0 con 0x7f60c8152e30 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60c77fe640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 0x7f60c8153c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60b800c7b0 tx=0x7f60b800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b8003b70 con 0x7f60c8152e30 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60b8003d10 con 0x7f60c8152e30 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b800aab0 con 0x7f60c8152e30 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.879+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c81f5460 con 0x7f60c8152e30 2024-09-10T11:39:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.880+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81f4980 con 0x7f60c8152e30 2024-09-10T11:39:08.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.881+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c806d3d0 con 0x7f60c8152e30 2024-09-10T11:39:08.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.881+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f60b800ac50 con 0x7f60c8152e30 2024-09-10T11:39:08.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.882+0000 7f60bffff640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a80750a0 0x7f60a8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:08.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.882+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f60b8096290 con 0x7f60c8152e30 2024-09-10T11:39:08.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.882+0000 7f60c6ffd640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a80750a0 0x7f60a8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:08.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.882+0000 7f60c6ffd640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a80750a0 0x7f60a8077560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60c0034000 tx=0x7f60c0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:08.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:08.885+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f60b8060550 con 0x7f60c8152e30 2024-09-10T11:39:09.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.085+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f60c80cdd40 con 0x7f60c8152e30 2024-09-10T11:39:09.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.085+0000 7f60bffff640 1 -- 172.21.15.57:0/940134103 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f60b805fe50 con 0x7f60c8152e30 2024-09-10T11:39:09.087 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:09.087 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a80750a0 msgr2=0x7f60a8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a80750a0 0x7f60a8077560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60c0034000 tx=0x7f60c0004730 comp rx=0 tx=0).stop 2024-09-10T11:39:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 msgr2=0x7f60c8153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 0x7f60c8153c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60b800c7b0 tx=0x7f60b800cc70 comp rx=0 tx=0).stop 2024-09-10T11:39:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 shutdown_connections 2024-09-10T11:39:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f60a80750a0 0x7f60a8077560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c8152e30 0x7f60c8153c90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60c80cccf0 0x7f60c8150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 --2- 172.21.15.57:0/940134103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60c806cb10 0x7f60c814f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 >> 172.21.15.57:0/940134103 conn(0x7f60c80b1780 msgr2=0x7f60c815a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 shutdown_connections 2024-09-10T11:39:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:09.087+0000 7f60cd990640 1 -- 172.21.15.57:0/940134103 wait complete. 2024-09-10T11:39:12.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.215+0000 7f974f1d1640 1 -- 172.21.15.57:0/1559799260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97480d43d0 msgr2=0x7f97480d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.215+0000 7f974f1d1640 1 --2- 172.21.15.57:0/1559799260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97480d43d0 0x7f97480d23c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9738009ca0 tx=0x7f973802aac0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.216+0000 7f974f1d1640 1 -- 172.21.15.57:0/1559799260 shutdown_connections 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.216+0000 7f974f1d1640 1 --2- 172.21.15.57:0/1559799260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97480b7190 0x7f97480b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.216+0000 7f974f1d1640 1 --2- 172.21.15.57:0/1559799260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97480d43d0 0x7f97480d23c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.216+0000 7f974f1d1640 1 -- 172.21.15.57:0/1559799260 >> 172.21.15.57:0/1559799260 conn(0x7f974809cf80 msgr2=0x7f97480d3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.216+0000 7f974f1d1640 1 -- 172.21.15.57:0/1559799260 shutdown_connections 2024-09-10T11:39:12.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.216+0000 7f974f1d1640 1 -- 172.21.15.57:0/1559799260 wait complete. 2024-09-10T11:39:12.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.217+0000 7f974f1d1640 1 Processor -- start 2024-09-10T11:39:12.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.217+0000 7f974f1d1640 1 -- start start 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974f1d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97480b7190 0x7f97481f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974f1d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97480d43d0 0x7f9748156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974f1d1640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 0x7f9748159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974f1d1640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f97480b7b30 con 0x7f9748161430 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974f1d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97480d2b10 con 0x7f97480b7190 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974f1d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f97480b7cb0 con 0x7f97480d43d0 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 0x7f9748159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 0x7f9748159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42802/0 (socket says 172.21.15.57:42802) 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 -- 172.21.15.57:0/2314546221 learned_addr learned my addr 172.21.15.57:0/2314546221 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974cf6d640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97480b7190 0x7f97481f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:12.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 -- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97480d43d0 msgr2=0x7f9748156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f9747fff640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97480d43d0 0x7f9748156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97480d43d0 0x7f9748156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 -- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97480b7190 msgr2=0x7f97481f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97480b7190 0x7f97481f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 -- 172.21.15.57:0/2314546221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97481f55e0 con 0x7f9748161430 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974cf6d640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97480b7190 0x7f97481f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.218+0000 7f974d76e640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 0x7f9748159940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f974000c970 tx=0x7f974000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.219+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740007b50 con 0x7f9748161430 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.219+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9740007de0 con 0x7f9748161430 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.219+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740005280 con 0x7f9748161430 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.219+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9748157a30 con 0x7f9748161430 2024-09-10T11:39:12.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.219+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97480cd430 con 0x7f9748161430 2024-09-10T11:39:12.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.220+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97481595d0 con 0x7f9748161430 2024-09-10T11:39:12.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.220+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f9740005420 con 0x7f9748161430 2024-09-10T11:39:12.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.221+0000 7f97457fa640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f97280750a0 0x7f9728077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:12.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.221+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9740096820 con 0x7f9748161430 2024-09-10T11:39:12.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.221+0000 7f974cf6d640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f97280750a0 0x7f9728077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:12.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.222+0000 7f974cf6d640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f97280750a0 0x7f9728077560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f973000a830 tx=0x7f9730008040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:12.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.225+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f97481f55e0 con 0x7f9748161430 2024-09-10T11:39:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.427+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f974806ebd0 con 0x7f9748161430 2024-09-10T11:39:12.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.427+0000 7f97457fa640 1 -- 172.21.15.57:0/2314546221 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f9740014030 con 0x7f9748161430 2024-09-10T11:39:12.429 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:12.429 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.429+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f97280750a0 msgr2=0x7f9728077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:12.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.429+0000 7f974f1d1640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f97280750a0 0x7f9728077560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f973000a830 tx=0x7f9730008040 comp rx=0 tx=0).stop 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.429+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 msgr2=0x7f9748159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.429+0000 7f974f1d1640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 0x7f9748159940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f974000c970 tx=0x7f974000ce30 comp rx=0 tx=0).stop 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 shutdown_connections 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f97280750a0 0x7f9728077560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9748161430 0x7f9748159940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97480d43d0 0x7f9748156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 --2- 172.21.15.57:0/2314546221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97480b7190 0x7f97481f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 >> 172.21.15.57:0/2314546221 conn(0x7f974809cf80 msgr2=0x7f974806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 shutdown_connections 2024-09-10T11:39:12.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:12.430+0000 7f974f1d1640 1 -- 172.21.15.57:0/2314546221 wait complete. 2024-09-10T11:39:15.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 -- 172.21.15.57:0/1737019734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40cf930 msgr2=0x7f78a40d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 --2- 172.21.15.57:0/1737019734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40cf930 0x7f78a40d13a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7894009830 tx=0x7f789402a510 comp rx=0 tx=0).stop 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 -- 172.21.15.57:0/1737019734 shutdown_connections 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 --2- 172.21.15.57:0/1737019734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a40d2330 0x7f78a40d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 --2- 172.21.15.57:0/1737019734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40cf930 0x7f78a40d13a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 -- 172.21.15.57:0/1737019734 >> 172.21.15.57:0/1737019734 conn(0x7f78a409cfd0 msgr2=0x7f78a40d3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:15.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 -- 172.21.15.57:0/1737019734 shutdown_connections 2024-09-10T11:39:15.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.559+0000 7f78ac53d640 1 -- 172.21.15.57:0/1737019734 wait complete. 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.560+0000 7f78ac53d640 1 Processor -- start 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.560+0000 7f78ac53d640 1 -- start start 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78ac53d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a40cf930 0x7f78a41f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78ac53d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40d2330 0x7f78a4160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78ac53d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 0x7f78a40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78ac53d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40b6fe0 con 0x7f78a415dc10 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78ac53d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40b6e60 con 0x7f78a40d2330 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78ac53d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f78a40b7160 con 0x7f78a40cf930 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 0x7f78a40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 0x7f78a40cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42816/0 (socket says 172.21.15.57:42816) 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 -- 172.21.15.57:0/980417280 learned_addr learned my addr 172.21.15.57:0/980417280 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:15.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aa2d9640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a40cf930 0x7f78a41f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78a9ad8640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40d2330 0x7f78a4160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 -- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a40cf930 msgr2=0x7f78a41f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a40cf930 0x7f78a41f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 -- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40d2330 msgr2=0x7f78a4160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40d2330 0x7f78a4160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 -- 172.21.15.57:0/980417280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a415f1f0 con 0x7f78a415dc10 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.561+0000 7f78aaada640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 0x7f78a40cd1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f789c00eb10 tx=0x7f789c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.562+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c004b20 con 0x7f78a415dc10 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.562+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a40cafc0 con 0x7f78a415dc10 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.562+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f789c004ce0 con 0x7f78a415dc10 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.562+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c005280 con 0x7f78a415dc10 2024-09-10T11:39:15.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.562+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a40cb580 con 0x7f78a415dc10 2024-09-10T11:39:15.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.563+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a40b7610 con 0x7f78a415dc10 2024-09-10T11:39:15.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.563+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f789c005420 con 0x7f78a415dc10 2024-09-10T11:39:15.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.564+0000 7f789affd640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f78880750d0 0x7f7888077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:15.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.564+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f789c097140 con 0x7f78a415dc10 2024-09-10T11:39:15.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.564+0000 7f78aa2d9640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f78880750d0 0x7f7888077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:15.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.565+0000 7f78aa2d9640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f78880750d0 0x7f7888077590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78a00015e0 tx=0x7f78a0009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:15.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.568+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f789c061380 con 0x7f78a415dc10 2024-09-10T11:39:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.771+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f78a408dd80 con 0x7f78a415dc10 2024-09-10T11:39:15.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.771+0000 7f789affd640 1 -- 172.21.15.57:0/980417280 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f789c060c80 con 0x7f78a415dc10 2024-09-10T11:39:15.773 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:15.773 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f78880750d0 msgr2=0x7f7888077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f78880750d0 0x7f7888077590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78a00015e0 tx=0x7f78a0009040 comp rx=0 tx=0).stop 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 msgr2=0x7f78a40cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 0x7f78a40cd1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f789c00eb10 tx=0x7f789c00c2d0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 shutdown_connections 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f78880750d0 0x7f7888077590 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78a415dc10 0x7f78a40cd1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a40d2330 0x7f78a4160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 --2- 172.21.15.57:0/980417280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a40cf930 0x7f78a41f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 >> 172.21.15.57:0/980417280 conn(0x7f78a409cfd0 msgr2=0x7f78a406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 shutdown_connections 2024-09-10T11:39:15.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:15.773+0000 7f78ac53d640 1 -- 172.21.15.57:0/980417280 wait complete. 2024-09-10T11:39:18.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:18.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.904+0000 7fd663a49640 1 -- 172.21.15.57:0/4057693756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b5900 msgr2=0x7fd65c0d4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.904+0000 7fd663a49640 1 --2- 172.21.15.57:0/4057693756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b5900 0x7fd65c0d4890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd658009830 tx=0x7fd65802a530 comp rx=0 tx=0).stop 2024-09-10T11:39:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.904+0000 7fd663a49640 1 -- 172.21.15.57:0/4057693756 shutdown_connections 2024-09-10T11:39:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.904+0000 7fd663a49640 1 --2- 172.21.15.57:0/4057693756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b5900 0x7fd65c0d4890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.904+0000 7fd663a49640 1 -- 172.21.15.57:0/4057693756 >> 172.21.15.57:0/4057693756 conn(0x7fd65c0d3da0 msgr2=0x7fd65c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.905+0000 7fd663a49640 1 -- 172.21.15.57:0/4057693756 shutdown_connections 2024-09-10T11:39:18.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.905+0000 7fd663a49640 1 -- 172.21.15.57:0/4057693756 wait complete. 2024-09-10T11:39:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.906+0000 7fd663a49640 1 Processor -- start 2024-09-10T11:39:18.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.906+0000 7fd663a49640 1 -- start start 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd663a49640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 0x7fd65c156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd663a49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd65c0b5900 0x7fd65c0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd663a49640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd65c161820 0x7fd65c0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd663a49640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c0b3eb0 con 0x7fd65c0b5900 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd663a49640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c0b3d30 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd663a49640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd65c0b4030 con 0x7fd65c161820 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 0x7fd65c156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd660fe4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd65c0b5900 0x7fd65c0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 0x7fd65c156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:43864/0 (socket says 172.21.15.57:43864) 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 -- 172.21.15.57:0/1726342078 learned_addr learned my addr 172.21.15.57:0/1726342078 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:18.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd661fe6640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd65c161820 0x7fd65c0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 -- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd65c161820 msgr2=0x7fd65c0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd65c161820 0x7fd65c0c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 -- 172.21.15.57:0/1726342078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd65c0b5900 msgr2=0x7fd65c0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd65c0b5900 0x7fd65c0c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd6617e5640 1 -- 172.21.15.57:0/1726342078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c1f52f0 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.907+0000 7fd660fe4640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd65c0b5900 0x7fd65c0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.908+0000 7fd6617e5640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 0x7fd65c156360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd658009950 tx=0x7fd658032c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.908+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658040070 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.908+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd658005310 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.908+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c0c75d0 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.908+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658005c90 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.908+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c0c9290 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.910+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c0d1970 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.910+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd658039040 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.910+0000 7fd651ffb640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6400750a0 0x7fd640077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.910+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd6580b74c0 con 0x7fd65c0b4bd0 2024-09-10T11:39:18.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.911+0000 7fd660fe4640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6400750a0 0x7fd640077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:18.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.911+0000 7fd660fe4640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6400750a0 0x7fd640077560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0c89b0 tx=0x7fd64c001820 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:18.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:18.914+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd65c0d1970 con 0x7fd65c0b4bd0 2024-09-10T11:39:19.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.276+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd65c0d4890 con 0x7fd65c0b4bd0 2024-09-10T11:39:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.277+0000 7fd651ffb640 1 -- 172.21.15.57:0/1726342078 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd6580811e0 con 0x7fd65c0b4bd0 2024-09-10T11:39:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6400750a0 msgr2=0x7fd640077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6400750a0 0x7fd640077560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0c89b0 tx=0x7fd64c001820 comp rx=0 tx=0).stop 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 msgr2=0x7fd65c156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 0x7fd65c156360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd658009950 tx=0x7fd658032c10 comp rx=0 tx=0).stop 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 shutdown_connections 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6400750a0 0x7fd640077560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd65c161820 0x7fd65c0c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd65c0b5900 0x7fd65c0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.279+0000 7fd663a49640 1 --2- 172.21.15.57:0/1726342078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd65c0b4bd0 0x7fd65c156360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.280+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 >> 172.21.15.57:0/1726342078 conn(0x7fd65c0d3da0 msgr2=0x7fd65c0d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.280+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 shutdown_connections 2024-09-10T11:39:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:19.280+0000 7fd663a49640 1 -- 172.21.15.57:0/1726342078 wait complete. 2024-09-10T11:39:22.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 -- 172.21.15.57:0/2573039059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00cf730 msgr2=0x7f42e01601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 --2- 172.21.15.57:0/2573039059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00cf730 0x7f42e01601a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f42e008d470 tx=0x7f42d802a8b0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 -- 172.21.15.57:0/2573039059 shutdown_connections 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 --2- 172.21.15.57:0/2573039059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00cf730 0x7f42e01601a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 --2- 172.21.15.57:0/2573039059 >> v2:172.21.15.154:3300/0 conn(0x7f42e015e1d0 0x7f42e00ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 -- 172.21.15.57:0/2573039059 >> 172.21.15.57:0/2573039059 conn(0x7f42e00d3dc0 msgr2=0x7f42e00d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 -- 172.21.15.57:0/2573039059 shutdown_connections 2024-09-10T11:39:22.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.410+0000 7f42e7465640 1 -- 172.21.15.57:0/2573039059 wait complete. 2024-09-10T11:39:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.411+0000 7f42e7465640 1 Processor -- start 2024-09-10T11:39:22.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.411+0000 7f42e7465640 1 -- start start 2024-09-10T11:39:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e7465640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e00cf730 0x7f42e014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e7465640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 0x7f42e00cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e7465640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e00b3540 0x7f42e015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e7465640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f42e0160b50 con 0x7f42e00d48e0 2024-09-10T11:39:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e7465640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42e01609d0 con 0x7f42e00b3540 2024-09-10T11:39:22.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e7465640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f42e0160cd0 con 0x7f42e00cf730 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 0x7f42e00cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e5201640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e00cf730 0x7f42e014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 0x7f42e00cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40586/0 (socket says 172.21.15.57:40586) 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e4a00640 1 -- 172.21.15.57:0/4046807461 learned_addr learned my addr 172.21.15.57:0/4046807461 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.412+0000 7f42e5a02640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e00b3540 0x7f42e015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e4a00640 1 -- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e00cf730 msgr2=0x7f42e014f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e4a00640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e00cf730 0x7f42e014f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e4a00640 1 -- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e00b3540 msgr2=0x7f42e015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e4a00640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e00b3540 0x7f42e015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e4a00640 1 -- 172.21.15.57:0/4046807461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e01f4a50 con 0x7f42e00d48e0 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e5201640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e00cf730 0x7f42e014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e4a00640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 0x7f42e00cc5e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c530 tx=0x7f42d000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:22.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0017070 con 0x7f42e00d48e0 2024-09-10T11:39:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42d00035f0 con 0x7f42e00d48e0 2024-09-10T11:39:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e01f4cf0 con 0x7f42e00d48e0 2024-09-10T11:39:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0003a40 con 0x7f42e00d48e0 2024-09-10T11:39:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.413+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e01f52b0 con 0x7f42e00d48e0 2024-09-10T11:39:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.415+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e0161180 con 0x7f42e00d48e0 2024-09-10T11:39:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.415+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f42d001a070 con 0x7f42e00d48e0 2024-09-10T11:39:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.416+0000 7f42d5ffb640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42c40750a0 0x7f42c4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.416+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f42d0095690 con 0x7f42e00d48e0 2024-09-10T11:39:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.416+0000 7f42e5201640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42c40750a0 0x7f42c4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:22.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.417+0000 7f42e5201640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42c40750a0 0x7f42c4077560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42dc005fd0 tx=0x7f42dc00f360 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:22.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.420+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f42d005f3b0 con 0x7f42e00d48e0 2024-09-10T11:39:22.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.786+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f42e01618a0 con 0x7f42e00d48e0 2024-09-10T11:39:22.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.787+0000 7f42d5ffb640 1 -- 172.21.15.57:0/4046807461 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f42d0063b70 con 0x7f42e00d48e0 2024-09-10T11:39:22.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:22.789 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42c40750a0 msgr2=0x7f42c4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42c40750a0 0x7f42c4077560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42dc005fd0 tx=0x7f42dc00f360 comp rx=0 tx=0).stop 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 msgr2=0x7f42e00cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 0x7f42e00cc5e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c530 tx=0x7f42d000c9f0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 shutdown_connections 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42c40750a0 0x7f42c4077560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e00b3540 0x7f42e015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42e00d48e0 0x7f42e00cc5e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 --2- 172.21.15.57:0/4046807461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42e00cf730 0x7f42e014f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 >> 172.21.15.57:0/4046807461 conn(0x7f42e00d3dc0 msgr2=0x7f42e006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 shutdown_connections 2024-09-10T11:39:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:22.790+0000 7f42e7465640 1 -- 172.21.15.57:0/4046807461 wait complete. 2024-09-10T11:39:25.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:25.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.942+0000 7f8f8e871640 1 -- 172.21.15.57:0/1229447674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8815e1d0 msgr2=0x7f8f880ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:25.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.942+0000 7f8f8e871640 1 --2- 172.21.15.57:0/1229447674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8815e1d0 0x7f8f880ceae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f8808d470 tx=0x7f8f7802a530 comp rx=0 tx=0).stop 2024-09-10T11:39:25.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.943+0000 7f8f8e871640 1 -- 172.21.15.57:0/1229447674 shutdown_connections 2024-09-10T11:39:25.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.943+0000 7f8f8e871640 1 --2- 172.21.15.57:0/1229447674 >> v2:172.21.15.57:3300/0 conn(0x7f8f880cf730 0x7f8f881601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:25.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.943+0000 7f8f8e871640 1 --2- 172.21.15.57:0/1229447674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8815e1d0 0x7f8f880ceae0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:25.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.943+0000 7f8f8e871640 1 -- 172.21.15.57:0/1229447674 >> 172.21.15.57:0/1229447674 conn(0x7f8f880d3dc0 msgr2=0x7f8f880d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:25.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.943+0000 7f8f8e871640 1 -- 172.21.15.57:0/1229447674 shutdown_connections 2024-09-10T11:39:25.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.943+0000 7f8f8e871640 1 -- 172.21.15.57:0/1229447674 wait complete. 2024-09-10T11:39:25.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.944+0000 7f8f8e871640 1 Processor -- start 2024-09-10T11:39:25.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.944+0000 7f8f8e871640 1 -- start start 2024-09-10T11:39:25.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8e871640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 0x7f8f88154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:25.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8e871640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f880d48e0 0x7f8f880b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:25.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8e871640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f880b5ba0 0x7f8f880b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:25.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8e871640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88160b50 con 0x7f8f880cf730 2024-09-10T11:39:25.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8e871640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881609d0 con 0x7f8f880b5ba0 2024-09-10T11:39:25.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8e871640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8f88160cd0 con 0x7f8f880d48e0 2024-09-10T11:39:25.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 0x7f8f88154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 0x7f8f88154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40612/0 (socket says 172.21.15.57:40612) 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 -- 172.21.15.57:0/3367014304 learned_addr learned my addr 172.21.15.57:0/3367014304 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f877fe640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f880d48e0 0x7f8f880b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f8ce0e640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f880b5ba0 0x7f8f880b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 -- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f880d48e0 msgr2=0x7f8f880b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f880d48e0 0x7f8f880b91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 -- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f880b5ba0 msgr2=0x7f8f880b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f880b5ba0 0x7f8f880b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.946+0000 7f8f87fff640 1 -- 172.21.15.57:0/3367014304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f880b4de0 con 0x7f8f880cf730 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.947+0000 7f8f87fff640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 0x7f8f88154bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009780 tx=0x7f8f78033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.947+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78031d60 con 0x7f8f880cf730 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.947+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f880b50c0 con 0x7f8f880cf730 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.947+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f78033e10 con 0x7f8f880cf730 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.947+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f880b5680 con 0x7f8f880cf730 2024-09-10T11:39:25.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.947+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78031d60 con 0x7f8f880cf730 2024-09-10T11:39:25.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.948+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88161180 con 0x7f8f880cf730 2024-09-10T11:39:25.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.950+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8f78005020 con 0x7f8f880cf730 2024-09-10T11:39:25.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.950+0000 7f8f84ff9640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8f740752a0 0x7f8f74077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:25.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.950+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8f780b6f00 con 0x7f8f880cf730 2024-09-10T11:39:25.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.950+0000 7f8f877fe640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8f740752a0 0x7f8f74077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:25.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.951+0000 7f8f877fe640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8f740752a0 0x7f8f74077760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f880c8280 tx=0x7f8f7c007e90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:25.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:25.953+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8f7803f030 con 0x7f8f880cf730 2024-09-10T11:39:26.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.202+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f880b58c0 con 0x7f8f880cf730 2024-09-10T11:39:26.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.202+0000 7f8f84ff9640 1 -- 172.21.15.57:0/3367014304 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f8f78031770 con 0x7f8f880cf730 2024-09-10T11:39:26.204 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:26.205 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8f740752a0 msgr2=0x7f8f74077760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8f740752a0 0x7f8f74077760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f880c8280 tx=0x7f8f7c007e90 comp rx=0 tx=0).stop 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 msgr2=0x7f8f88154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 0x7f8f88154bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009780 tx=0x7f8f78033c20 comp rx=0 tx=0).stop 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 shutdown_connections 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8f740752a0 0x7f8f74077760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f880b5ba0 0x7f8f880b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f880d48e0 0x7f8f880b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 --2- 172.21.15.57:0/3367014304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8f880cf730 0x7f8f88154bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:26.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 >> 172.21.15.57:0/3367014304 conn(0x7f8f880d3dc0 msgr2=0x7f8f880b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:26.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 shutdown_connections 2024-09-10T11:39:26.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:26.205+0000 7f8f8e871640 1 -- 172.21.15.57:0/3367014304 wait complete. 2024-09-10T11:39:29.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 -- 172.21.15.57:0/585662461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c06e140 msgr2=0x7fa81c0704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 --2- 172.21.15.57:0/585662461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c06e140 0x7fa81c0704e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009830 tx=0x7fa80c02a510 comp rx=0 tx=0).stop 2024-09-10T11:39:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 -- 172.21.15.57:0/585662461 shutdown_connections 2024-09-10T11:39:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 --2- 172.21.15.57:0/585662461 >> v2:172.21.15.154:3300/0 conn(0x7fa81c0b4da0 0x7fa81c0ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 --2- 172.21.15.57:0/585662461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c06e140 0x7fa81c0704e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 -- 172.21.15.57:0/585662461 >> 172.21.15.57:0/585662461 conn(0x7fa81c0b2870 msgr2=0x7fa81c0b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:29.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 -- 172.21.15.57:0/585662461 shutdown_connections 2024-09-10T11:39:29.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.355+0000 7fa824364640 1 -- 172.21.15.57:0/585662461 wait complete. 2024-09-10T11:39:29.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.356+0000 7fa824364640 1 Processor -- start 2024-09-10T11:39:29.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.356+0000 7fa824364640 1 -- start start 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa824364640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81c06e140 0x7fa81c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa824364640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c0b4da0 0x7fa81c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa824364640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa81c15deb0 0x7fa81c0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa824364640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c0cf200 con 0x7fa81c15deb0 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa824364640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c0cf080 con 0x7fa81c06e140 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa824364640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa81c0cf380 con 0x7fa81c0b4da0 2024-09-10T11:39:29.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa822901640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa81c15deb0 0x7fa81c0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa8218ff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c0b4da0 0x7fa81c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa822100640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81c06e140 0x7fa81c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.357+0000 7fa8218ff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c0b4da0 0x7fa81c15b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:53440/0 (socket says 172.21.15.57:53440) 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa8218ff640 1 -- 172.21.15.57:0/1639420098 learned_addr learned my addr 172.21.15.57:0/1639420098 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa822901640 1 -- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c0b4da0 msgr2=0x7fa81c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa822901640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c0b4da0 0x7fa81c15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa822901640 1 -- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81c06e140 msgr2=0x7fa81c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa822901640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81c06e140 0x7fa81c0b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa822901640 1 -- 172.21.15.57:0/1639420098 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c15bd60 con 0x7fa81c15deb0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa822901640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa81c15deb0 0x7fa81c0ca950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa81400e9d0 tx=0x7fa81400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81400cd80 con 0x7fa81c15deb0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa814004b20 con 0x7fa81c15deb0 2024-09-10T11:39:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c15c040 con 0x7fa81c15deb0 2024-09-10T11:39:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814005020 con 0x7fa81c15deb0 2024-09-10T11:39:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.358+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c15c600 con 0x7fa81c15deb0 2024-09-10T11:39:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.360+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81c0761a0 con 0x7fa81c15deb0 2024-09-10T11:39:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.360+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa8140051c0 con 0x7fa81c15deb0 2024-09-10T11:39:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.361+0000 7fa812ffd640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8000750a0 0x7fa800077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.361+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa814096fd0 con 0x7fa81c15deb0 2024-09-10T11:39:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.361+0000 7fa822100640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8000750a0 0x7fa800077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:29.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.362+0000 7fa822100640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8000750a0 0x7fa800077560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa818007fd0 tx=0x7fa818001370 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:29.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.367+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fa814060c60 con 0x7fa81c15deb0 2024-09-10T11:39:29.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.686+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa81c06cd50 con 0x7fa81c15deb0 2024-09-10T11:39:29.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.686+0000 7fa812ffd640 1 -- 172.21.15.57:0/1639420098 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa814065420 con 0x7fa81c15deb0 2024-09-10T11:39:29.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:29.688 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8000750a0 msgr2=0x7fa800077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8000750a0 0x7fa800077560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa818007fd0 tx=0x7fa818001370 comp rx=0 tx=0).stop 2024-09-10T11:39:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa81c15deb0 msgr2=0x7fa81c0ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa81c15deb0 0x7fa81c0ca950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa81400e9d0 tx=0x7fa81400ee90 comp rx=0 tx=0).stop 2024-09-10T11:39:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 shutdown_connections 2024-09-10T11:39:29.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa8000750a0 0x7fa800077560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa81c15deb0 0x7fa81c0ca950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa81c0b4da0 0x7fa81c15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 --2- 172.21.15.57:0/1639420098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81c06e140 0x7fa81c0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 >> 172.21.15.57:0/1639420098 conn(0x7fa81c0b2870 msgr2=0x7fa81c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 shutdown_connections 2024-09-10T11:39:29.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:29.688+0000 7fa824364640 1 -- 172.21.15.57:0/1639420098 wait complete. 2024-09-10T11:39:30.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:39:30.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:39:32.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:32.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.842+0000 7fb28c0c8640 1 -- 172.21.15.57:0/1930894692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2840d43d0 msgr2=0x7fb2840d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:32.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.842+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/1930894692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2840d43d0 0x7fb2840d23c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb274009860 tx=0x7fb27402a610 comp rx=0 tx=0).stop 2024-09-10T11:39:32.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.843+0000 7fb28c0c8640 1 -- 172.21.15.57:0/1930894692 shutdown_connections 2024-09-10T11:39:32.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.843+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/1930894692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2840d43d0 0x7fb2840d23c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:32.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.843+0000 7fb28c0c8640 1 -- 172.21.15.57:0/1930894692 >> 172.21.15.57:0/1930894692 conn(0x7fb28409cf80 msgr2=0x7fb2840d3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:32.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.843+0000 7fb28c0c8640 1 -- 172.21.15.57:0/1930894692 shutdown_connections 2024-09-10T11:39:32.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.843+0000 7fb28c0c8640 1 -- 172.21.15.57:0/1930894692 wait complete. 2024-09-10T11:39:32.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.844+0000 7fb28c0c8640 1 Processor -- start 2024-09-10T11:39:32.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.845+0000 7fb28c0c8640 1 -- start start 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28c0c8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2840b7190 0x7fb284157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28c0c8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 0x7fb2840cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28c0c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb284161430 0x7fb2840cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28c0c8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840d2b10 con 0x7fb2840d43d0 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28c0c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840b7d30 con 0x7fb284161430 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28c0c8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb2840c7700 con 0x7fb2840b7190 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 0x7fb2840cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:32.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 0x7fb2840cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60680/0 (socket says 172.21.15.57:60680) 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 -- 172.21.15.57:0/2828850630 learned_addr learned my addr 172.21.15.57:0/2828850630 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289e64640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2840b7190 0x7fb284157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb28a665640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb284161430 0x7fb2840cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 -- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2840b7190 msgr2=0x7fb284157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2840b7190 0x7fb284157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 -- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb284161430 msgr2=0x7fb2840cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb284161430 0x7fb2840cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 -- 172.21.15.57:0/2828850630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840cdae0 con 0x7fb2840d43d0 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.846+0000 7fb289663640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 0x7fb2840cb980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb27402ac00 tx=0x7fb274030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.847+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274040070 con 0x7fb2840d43d0 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.847+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb274030d40 con 0x7fb2840d43d0 2024-09-10T11:39:32.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.847+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274004280 con 0x7fb2840d43d0 2024-09-10T11:39:32.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.847+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb284158440 con 0x7fb2840d43d0 2024-09-10T11:39:32.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.847+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb284158a00 con 0x7fb2840d43d0 2024-09-10T11:39:32.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.849+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2840ca650 con 0x7fb2840d43d0 2024-09-10T11:39:32.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.849+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb274039040 con 0x7fb2840d43d0 2024-09-10T11:39:32.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.850+0000 7fb27a7fc640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb2680750a0 0x7fb268077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:32.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.850+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb2740b6c00 con 0x7fb2840d43d0 2024-09-10T11:39:32.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.850+0000 7fb289e64640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb2680750a0 0x7fb268077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:32.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.851+0000 7fb289e64640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb2680750a0 0x7fb268077560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb280001220 tx=0x7fb280001c70 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:32.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:32.856+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb2840ca650 con 0x7fb2840d43d0 2024-09-10T11:39:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.156+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb2840b81b0 con 0x7fb2840d43d0 2024-09-10T11:39:33.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.156+0000 7fb27a7fc640 1 -- 172.21.15.57:0/2828850630 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb274080870 con 0x7fb2840d43d0 2024-09-10T11:39:33.159 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:33.159 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb2680750a0 msgr2=0x7fb268077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb2680750a0 0x7fb268077560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb280001220 tx=0x7fb280001c70 comp rx=0 tx=0).stop 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 msgr2=0x7fb2840cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 0x7fb2840cb980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb27402ac00 tx=0x7fb274030650 comp rx=0 tx=0).stop 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 shutdown_connections 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb2680750a0 0x7fb268077560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb284161430 0x7fb2840cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2840d43d0 0x7fb2840cb980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 --2- 172.21.15.57:0/2828850630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2840b7190 0x7fb284157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 >> 172.21.15.57:0/2828850630 conn(0x7fb28409cf80 msgr2=0x7fb2840d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:33.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 shutdown_connections 2024-09-10T11:39:33.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:33.159+0000 7fb28c0c8640 1 -- 172.21.15.57:0/2828850630 wait complete. 2024-09-10T11:39:36.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:36.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 -- 172.21.15.57:0/3308456762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415f280 msgr2=0x7fba340af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 --2- 172.21.15.57:0/3308456762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415f280 0x7fba340af430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba2c005fd0 tx=0x7fba2c02a8b0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 -- 172.21.15.57:0/3308456762 shutdown_connections 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 --2- 172.21.15.57:0/3308456762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415f280 0x7fba340af430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 --2- 172.21.15.57:0/3308456762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba3415eea0 0x7fba340cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 -- 172.21.15.57:0/3308456762 >> 172.21.15.57:0/3308456762 conn(0x7fba340d1ac0 msgr2=0x7fba340d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 -- 172.21.15.57:0/3308456762 shutdown_connections 2024-09-10T11:39:36.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.297+0000 7fba3a75d640 1 -- 172.21.15.57:0/3308456762 wait complete. 2024-09-10T11:39:36.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.299+0000 7fba3a75d640 1 Processor -- start 2024-09-10T11:39:36.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.299+0000 7fba3a75d640 1 -- start start 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba3a75d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba340d25e0 0x7fba340c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba3a75d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 0x7fba340b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba3a75d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba3415f280 0x7fba340b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba337fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 0x7fba340b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba337fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 0x7fba340b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60702/0 (socket says 172.21.15.57:60702) 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba337fe640 1 -- 172.21.15.57:0/1267120435 learned_addr learned my addr 172.21.15.57:0/1267120435 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:36.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba33fff640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba340d25e0 0x7fba340c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba3a75d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fba340afd00 con 0x7fba3415eea0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba340afb80 con 0x7fba340d25e0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fba340afe80 con 0x7fba3415f280 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.300+0000 7fba38cfa640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba3415f280 0x7fba340b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba337fe640 1 -- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba3415f280 msgr2=0x7fba340b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba337fe640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba3415f280 0x7fba340b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba337fe640 1 -- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba340d25e0 msgr2=0x7fba340c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba337fe640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba340d25e0 0x7fba340c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba337fe640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba340cd930 con 0x7fba3415eea0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba337fe640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 0x7fba340b48f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c460 tx=0x7fba2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28016020 con 0x7fba3415eea0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba28012920 con 0x7fba3415eea0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba340cdc10 con 0x7fba3415eea0 2024-09-10T11:39:36.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28012d50 con 0x7fba3415eea0 2024-09-10T11:39:36.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.301+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba340ce1d0 con 0x7fba3415eea0 2024-09-10T11:39:36.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.303+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba340af430 con 0x7fba3415eea0 2024-09-10T11:39:36.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.303+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fba28019020 con 0x7fba3415eea0 2024-09-10T11:39:36.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.304+0000 7fba30ff9640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fba200750a0 0x7fba20077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:36.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.304+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fba28095ee0 con 0x7fba3415eea0 2024-09-10T11:39:36.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.304+0000 7fba33fff640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fba200750a0 0x7fba20077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:36.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.305+0000 7fba33fff640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fba200750a0 0x7fba20077560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba340b2b30 tx=0x7fba24005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:36.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.310+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fba28020030 con 0x7fba3415eea0 2024-09-10T11:39:36.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.530+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba340c4f10 con 0x7fba3415eea0 2024-09-10T11:39:36.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.531+0000 7fba30ff9640 1 -- 172.21.15.57:0/1267120435 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fba2805fc30 con 0x7fba3415eea0 2024-09-10T11:39:36.532 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:36.532 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:36.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.532+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fba200750a0 msgr2=0x7fba20077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fba200750a0 0x7fba20077560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba340b2b30 tx=0x7fba24005f90 comp rx=0 tx=0).stop 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 msgr2=0x7fba340b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 0x7fba340b48f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c460 tx=0x7fba2800c920 comp rx=0 tx=0).stop 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 shutdown_connections 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fba200750a0 0x7fba20077560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba3415f280 0x7fba340b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba3415eea0 0x7fba340b48f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 --2- 172.21.15.57:0/1267120435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba340d25e0 0x7fba340c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 >> 172.21.15.57:0/1267120435 conn(0x7fba340d1ac0 msgr2=0x7fba340cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 shutdown_connections 2024-09-10T11:39:36.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:36.533+0000 7fba3a75d640 1 -- 172.21.15.57:0/1267120435 wait complete. 2024-09-10T11:39:39.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 -- 172.21.15.57:0/3432378875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b00b3a00 msgr2=0x7f42b00b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 --2- 172.21.15.57:0/3432378875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b00b3a00 0x7f42b00b3e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f42a0005fd0 tx=0x7f42a002a5d0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 -- 172.21.15.57:0/3432378875 shutdown_connections 2024-09-10T11:39:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 --2- 172.21.15.57:0/3432378875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b00b3a00 0x7f42b00b3e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 --2- 172.21.15.57:0/3432378875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b00735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 -- 172.21.15.57:0/3432378875 >> 172.21.15.57:0/3432378875 conn(0x7f42b00d0a90 msgr2=0x7f42b00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 -- 172.21.15.57:0/3432378875 shutdown_connections 2024-09-10T11:39:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.673+0000 7f42b8539640 1 -- 172.21.15.57:0/3432378875 wait complete. 2024-09-10T11:39:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.674+0000 7f42b8539640 1 Processor -- start 2024-09-10T11:39:39.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.674+0000 7f42b8539640 1 -- start start 2024-09-10T11:39:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b8539640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b8539640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b00b3a00 0x7f42b00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b8539640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b015e580 0x7f42b00ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b8539640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f42b00701d0 con 0x7f42b015e580 2024-09-10T11:39:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b8539640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42b0070050 con 0x7f42b00b3a00 2024-09-10T11:39:39.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b8539640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f42b0070350 con 0x7f42b00731e0 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b6ad6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b015e580 0x7f42b00ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b5ad4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b00b3a00 0x7f42b00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:53358/0 (socket says 172.21.15.57:53358) 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 -- 172.21.15.57:0/1015726936 learned_addr learned my addr 172.21.15.57:0/1015726936 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 -- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b00b3a00 msgr2=0x7f42b00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b00b3a00 0x7f42b00cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 -- 172.21.15.57:0/1015726936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b015e580 msgr2=0x7f42b00ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b015e580 0x7f42b00ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.675+0000 7f42b62d5640 1 -- 172.21.15.57:0/1015726936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b014cfc0 con 0x7f42b00731e0 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42b5ad4640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b00b3a00 0x7f42b00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42b6ad6640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b015e580 0x7f42b00ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:39.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42b62d5640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b014c950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00ea20 tx=0x7f42ac00eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00cd80 con 0x7f42b00731e0 2024-09-10T11:39:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42ac010430 con 0x7f42b00731e0 2024-09-10T11:39:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b014d2a0 con 0x7f42b00731e0 2024-09-10T11:39:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac010840 con 0x7f42b00731e0 2024-09-10T11:39:39.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.676+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b00ce260 con 0x7f42b00731e0 2024-09-10T11:39:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.677+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b015f220 con 0x7f42b00731e0 2024-09-10T11:39:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.678+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f42ac0109e0 con 0x7f42b00731e0 2024-09-10T11:39:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.679+0000 7f42a6ffd640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42940750a0 0x7f4294077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.679+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f42ac096e00 con 0x7f42b00731e0 2024-09-10T11:39:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.679+0000 7f42b5ad4640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42940750a0 0x7f4294077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:39.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.680+0000 7f42b5ad4640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42940750a0 0x7f4294077560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42a0033000 tx=0x7f42a003c040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:39.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.684+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f42ac060b20 con 0x7f42b00731e0 2024-09-10T11:39:39.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.964+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f42b014b360 con 0x7f42b00731e0 2024-09-10T11:39:39.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.964+0000 7f42a6ffd640 1 -- 172.21.15.57:0/1015726936 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f42ac0652e0 con 0x7f42b00731e0 2024-09-10T11:39:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:39.965 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:39.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42940750a0 msgr2=0x7f4294077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:39.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42940750a0 0x7f4294077560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42a0033000 tx=0x7f42a003c040 comp rx=0 tx=0).stop 2024-09-10T11:39:39.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 msgr2=0x7f42b014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:39.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b014c950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00ea20 tx=0x7f42ac00eee0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 shutdown_connections 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f42940750a0 0x7f4294077560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42b015e580 0x7f42b00ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42b00b3a00 0x7f42b00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 --2- 172.21.15.57:0/1015726936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42b00731e0 0x7f42b014c950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 >> 172.21.15.57:0/1015726936 conn(0x7f42b00d0a90 msgr2=0x7f42b0159690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 shutdown_connections 2024-09-10T11:39:39.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:39.966+0000 7f42b8539640 1 -- 172.21.15.57:0/1015726936 wait complete. 2024-09-10T11:39:42.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 -- 172.21.15.57:0/2675811543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c0b5900 msgr2=0x7f0f7c0d4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 --2- 172.21.15.57:0/2675811543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c0b5900 0x7f0f7c0d4890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b9e00 tx=0x7f0f6c02a4d0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 -- 172.21.15.57:0/2675811543 shutdown_connections 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 --2- 172.21.15.57:0/2675811543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f7c161110 0x7f0f7c161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 --2- 172.21.15.57:0/2675811543 >> v2:172.21.15.154:3300/0 conn(0x7f0f7c0b4bd0 0x7f0f7c0b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 --2- 172.21.15.57:0/2675811543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c0b5900 0x7f0f7c0d4890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 -- 172.21.15.57:0/2675811543 >> 172.21.15.57:0/2675811543 conn(0x7f0f7c0d3da0 msgr2=0x7f0f7c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.120+0000 7f0f8136c640 1 -- 172.21.15.57:0/2675811543 shutdown_connections 2024-09-10T11:39:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.121+0000 7f0f8136c640 1 -- 172.21.15.57:0/2675811543 wait complete. 2024-09-10T11:39:43.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.122+0000 7f0f8136c640 1 Processor -- start 2024-09-10T11:39:43.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.122+0000 7f0f8136c640 1 -- start start 2024-09-10T11:39:43.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.123+0000 7f0f8136c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 0x7f0f7c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:43.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.123+0000 7f0f8136c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f7c0b5900 0x7f0f7c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.123+0000 7f0f8136c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c161110 0x7f0f7c0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.123+0000 7f0f8136c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d20b0 con 0x7f0f7c161110 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.123+0000 7f0f8136c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d1f30 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.123+0000 7f0f8136c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0d2230 con 0x7f0f7c0b5900 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 0x7f0f7c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c161110 0x7f0f7c0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 0x7f0f7c0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:40460/0 (socket says 172.21.15.57:40460) 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 -- 172.21.15.57:0/3372608827 learned_addr learned my addr 172.21.15.57:0/3372608827 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f73fff640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f7c0b5900 0x7f0f7c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 -- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f7c0b5900 msgr2=0x7f0f7c0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f7c0b5900 0x7f0f7c0ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 -- 172.21.15.57:0/3372608827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c161110 msgr2=0x7f0f7c0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c161110 0x7f0f7c0cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 -- 172.21.15.57:0/3372608827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c1f5950 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7b7fe640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c161110 0x7f0f7c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f7affd640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 0x7f0f7c0c9dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009850 tx=0x7f0f6c0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c03f070 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f6c0047a0 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.124+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c1f5bc0 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.125+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c035030 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.125+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c0cd6c0 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.126+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c1f5fb0 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.126+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0f6c042070 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.127+0000 7f0f737fe640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0f5c0750a0 0x7f0f5c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:43.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.127+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f0f6c0b6fe0 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.127+0000 7f0f73fff640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0f5c0750a0 0x7f0f5c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.128+0000 7f0f73fff640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0f5c0750a0 0x7f0f5c077560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f640095f0 tx=0x7f0f64005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:43.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.132+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f0f6c080c30 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.404+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0f7c0d2b50 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.405+0000 7f0f737fe640 1 -- 172.21.15.57:0/3372608827 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f0f6c0853f0 con 0x7f0f7c0b4bd0 2024-09-10T11:39:43.406 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:43.406 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0f5c0750a0 msgr2=0x7f0f5c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0f5c0750a0 0x7f0f5c077560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f640095f0 tx=0x7f0f64005f90 comp rx=0 tx=0).stop 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 msgr2=0x7f0f7c0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 0x7f0f7c0c9dd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009850 tx=0x7f0f6c0038a0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 shutdown_connections 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0f5c0750a0 0x7f0f5c077560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f7c161110 0x7f0f7c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f7c0b5900 0x7f0f7c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 --2- 172.21.15.57:0/3372608827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f7c0b4bd0 0x7f0f7c0c9dd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:43.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 >> 172.21.15.57:0/3372608827 conn(0x7f0f7c0d3da0 msgr2=0x7f0f7c06e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:43.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 shutdown_connections 2024-09-10T11:39:43.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:43.408+0000 7f0f8136c640 1 -- 172.21.15.57:0/3372608827 wait complete. 2024-09-10T11:39:46.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:46.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 -- 172.21.15.57:0/1220440291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a901611b0 msgr2=0x7f6a90168b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1220440291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a901611b0 0x7f6a90168b70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005fd0 tx=0x7f6a8802a940 comp rx=0 tx=0).stop 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 -- 172.21.15.57:0/1220440291 shutdown_connections 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1220440291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a901611b0 0x7f6a90168b70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 -- 172.21.15.57:0/1220440291 >> 172.21.15.57:0/1220440291 conn(0x7f6a900d3dc0 msgr2=0x7f6a900d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 -- 172.21.15.57:0/1220440291 shutdown_connections 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.558+0000 7f6a976c8640 1 -- 172.21.15.57:0/1220440291 wait complete. 2024-09-10T11:39:46.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.560+0000 7f6a976c8640 1 Processor -- start 2024-09-10T11:39:46.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.560+0000 7f6a976c8640 1 -- start start 2024-09-10T11:39:46.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a976c8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a900d48e0 0x7f6a901532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:46.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a976c8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 0x7f6a900cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:46.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a976c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a900cd630 0x7f6a9015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:46.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a976c8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90169440 con 0x7f6a901611b0 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a976c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901692c0 con 0x7f6a900cd630 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a976c8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6a901695c0 con 0x7f6a900d48e0 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 0x7f6a900cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 0x7f6a900cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35566/0 (socket says 172.21.15.57:35566) 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 -- 172.21.15.57:0/1599449878 learned_addr learned my addr 172.21.15.57:0/1599449878 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a95464640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a900d48e0 0x7f6a901532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a95c65640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a900cd630 0x7f6a9015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 -- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a900d48e0 msgr2=0x7f6a901532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a900d48e0 0x7f6a901532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 -- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a900cd630 msgr2=0x7f6a9015c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a900cd630 0x7f6a9015c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.561+0000 7f6a94c63640 1 -- 172.21.15.57:0/1599449878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9015cff0 con 0x7f6a901611b0 2024-09-10T11:39:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.562+0000 7f6a94c63640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 0x7f6a900cd0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c490 tx=0x7f6a8000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:46.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.562+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800052d0 con 0x7f6a901611b0 2024-09-10T11:39:46.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.562+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a80005490 con 0x7f6a901611b0 2024-09-10T11:39:46.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.562+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80012890 con 0x7f6a901611b0 2024-09-10T11:39:46.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.562+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a900cb010 con 0x7f6a901611b0 2024-09-10T11:39:46.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.562+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901537e0 con 0x7f6a901611b0 2024-09-10T11:39:46.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.564+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a900cda40 con 0x7f6a901611b0 2024-09-10T11:39:46.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.564+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f6a80012a30 con 0x7f6a901611b0 2024-09-10T11:39:46.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.565+0000 7f6a85ffb640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6a740750f0 0x7f6a740775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:46.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.565+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6a80095ce0 con 0x7f6a901611b0 2024-09-10T11:39:46.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.565+0000 7f6a95464640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6a740750f0 0x7f6a740775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:46.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.566+0000 7f6a95464640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6a740750f0 0x7f6a740775b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007fd0 tx=0x7f6a8c007eb0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:46.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.571+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f6a900cda40 con 0x7f6a901611b0 2024-09-10T11:39:46.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.874+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6a900cae00 con 0x7f6a901611b0 2024-09-10T11:39:46.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.874+0000 7f6a85ffb640 1 -- 172.21.15.57:0/1599449878 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f6a8005fa50 con 0x7f6a901611b0 2024-09-10T11:39:46.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:46.876 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:46.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6a740750f0 msgr2=0x7f6a740775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:46.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6a740750f0 0x7f6a740775b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007fd0 tx=0x7f6a8c007eb0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 msgr2=0x7f6a900cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:46.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 0x7f6a900cd0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c490 tx=0x7f6a8000c950 comp rx=0 tx=0).stop 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 shutdown_connections 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6a740750f0 0x7f6a740775b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a900cd630 0x7f6a9015c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a901611b0 0x7f6a900cd0f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 --2- 172.21.15.57:0/1599449878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a900d48e0 0x7f6a901532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 >> 172.21.15.57:0/1599449878 conn(0x7f6a900d3dc0 msgr2=0x7f6a900cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 shutdown_connections 2024-09-10T11:39:46.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:46.877+0000 7f6a976c8640 1 -- 172.21.15.57:0/1599449878 wait complete. 2024-09-10T11:39:49.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 -- 172.21.15.57:0/1306930821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 msgr2=0x7f3bd40c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 --2- 172.21.15.57:0/1306930821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd40c72c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40d01a0 tx=0x7f3bc402a440 comp rx=0 tx=0).stop 2024-09-10T11:39:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 -- 172.21.15.57:0/1306930821 shutdown_connections 2024-09-10T11:39:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 --2- 172.21.15.57:0/1306930821 >> v2:172.21.15.154:3300/0 conn(0x7f3bd40caa40 0x7f3bd40caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 --2- 172.21.15.57:0/1306930821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 0x7f3bd415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 --2- 172.21.15.57:0/1306930821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd40c72c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 -- 172.21.15.57:0/1306930821 >> 172.21.15.57:0/1306930821 conn(0x7f3bd40b1da0 msgr2=0x7f3bd40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 -- 172.21.15.57:0/1306930821 shutdown_connections 2024-09-10T11:39:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.029+0000 7f3bda00f640 1 -- 172.21.15.57:0/1306930821 wait complete. 2024-09-10T11:39:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.031+0000 7f3bda00f640 1 Processor -- start 2024-09-10T11:39:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.031+0000 7f3bda00f640 1 -- start start 2024-09-10T11:39:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bda00f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd40caa40 0x7f3bd409d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bda00f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd41e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bda00f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 0x7f3bd41e9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bda00f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd406d740 con 0x7f3bd415e1f0 2024-09-10T11:39:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bda00f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd406d5c0 con 0x7f3bd40caa40 2024-09-10T11:39:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bda00f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd406e350 con 0x7f3bd415e9f0 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bd2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd41e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bd2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd41e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59826/0 (socket says 172.21.15.57:59826) 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bd2ffd640 1 -- 172.21.15.57:0/3911659357 learned_addr learned my addr 172.21.15.57:0/3911659357 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.032+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd40caa40 0x7f3bd409d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd3fff640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 0x7f3bd41e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd37fe640 1 -- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 msgr2=0x7f3bd41e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 0x7f3bd41e9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd37fe640 1 -- 172.21.15.57:0/3911659357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 msgr2=0x7f3bd41e8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd41e8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd37fe640 1 -- 172.21.15.57:0/3911659357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd4159e20 con 0x7f3bd40caa40 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd3fff640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 0x7f3bd41e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bd37fe640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd40caa40 0x7f3bd409d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4031000 tx=0x7f3bc40038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc403f070 con 0x7f3bd40caa40 2024-09-10T11:39:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bc40047a0 con 0x7f3bd40caa40 2024-09-10T11:39:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4035030 con 0x7f3bd40caa40 2024-09-10T11:39:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.033+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd415a100 con 0x7f3bd40caa40 2024-09-10T11:39:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.034+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd415a6c0 con 0x7f3bd40caa40 2024-09-10T11:39:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.035+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd415e5d0 con 0x7f3bd40caa40 2024-09-10T11:39:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.036+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f3bc4042070 con 0x7f3bd40caa40 2024-09-10T11:39:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.036+0000 7f3bbbfff640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3bc00750a0 0x7f3bc0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.036+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f3bc40b72e0 con 0x7f3bd40caa40 2024-09-10T11:39:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.036+0000 7f3bd2ffd640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3bc00750a0 0x7f3bc0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:50.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.037+0000 7f3bd2ffd640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3bc00750a0 0x7f3bc0077560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4159a90 tx=0x7f3bc8005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.042+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f3bc4080f70 con 0x7f3bd40caa40 2024-09-10T11:39:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.323+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3bd40b60d0 con 0x7f3bd40caa40 2024-09-10T11:39:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.324+0000 7f3bbbfff640 1 -- 172.21.15.57:0/3911659357 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f3bc4085730 con 0x7f3bd40caa40 2024-09-10T11:39:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:50.325 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:50.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3bc00750a0 msgr2=0x7f3bc0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:50.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3bc00750a0 0x7f3bc0077560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4159a90 tx=0x7f3bc8005f90 comp rx=0 tx=0).stop 2024-09-10T11:39:50.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd40caa40 msgr2=0x7f3bd409d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd40caa40 0x7f3bd409d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4031000 tx=0x7f3bc40038a0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 shutdown_connections 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3bc00750a0 0x7f3bc0077560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd415e9f0 0x7f3bd41e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd415e1f0 0x7f3bd41e8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 --2- 172.21.15.57:0/3911659357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd40caa40 0x7f3bd409d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 >> 172.21.15.57:0/3911659357 conn(0x7f3bd40b1da0 msgr2=0x7f3bd40b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 shutdown_connections 2024-09-10T11:39:50.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:50.327+0000 7f3bda00f640 1 -- 172.21.15.57:0/3911659357 wait complete. 2024-09-10T11:39:53.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:53.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 -- 172.21.15.57:0/1041973088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f5015e580 msgr2=0x7f5f5015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:53.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1041973088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f5015e580 0x7f5f5015e9a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5f50072db0 tx=0x7f5f4802aa30 comp rx=0 tx=0).stop 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 -- 172.21.15.57:0/1041973088 shutdown_connections 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1041973088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f5015e580 0x7f5f5015e9a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1041973088 >> v2:172.21.15.154:3300/0 conn(0x7f5f500b3a00 0x7f5f500b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1041973088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500731e0 0x7f5f500735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 -- 172.21.15.57:0/1041973088 >> 172.21.15.57:0/1041973088 conn(0x7f5f500d0a90 msgr2=0x7f5f500d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 -- 172.21.15.57:0/1041973088 shutdown_connections 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.484+0000 7f5f56fca640 1 -- 172.21.15.57:0/1041973088 wait complete. 2024-09-10T11:39:53.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.486+0000 7f5f56fca640 1 Processor -- start 2024-09-10T11:39:53.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.486+0000 7f5f56fca640 1 -- start start 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f56fca640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 0x7f5f5014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f56fca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500b3a00 0x7f5f501f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f56fca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5015e580 0x7f5f501f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f56fca640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5015f060 con 0x7f5f500731e0 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f56fca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5015eee0 con 0x7f5f5015e580 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f56fca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5015f1e0 con 0x7f5f500b3a00 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f54d66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 0x7f5f5014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:53.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f54d66640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 0x7f5f5014f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59840/0 (socket says 172.21.15.57:59840) 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f54d66640 1 -- 172.21.15.57:0/1213618538 learned_addr learned my addr 172.21.15.57:0/1213618538 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f4ffff640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500b3a00 0x7f5f501f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.487+0000 7f5f55567640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5015e580 0x7f5f501f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f54d66640 1 -- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500b3a00 msgr2=0x7f5f501f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f54d66640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500b3a00 0x7f5f501f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f54d66640 1 -- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5015e580 msgr2=0x7f5f501f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f54d66640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5015e580 0x7f5f501f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f54d66640 1 -- 172.21.15.57:0/1213618538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f501567b0 con 0x7f5f500731e0 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f4ffff640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500b3a00 0x7f5f501f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f54d66640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 0x7f5f5014f530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e740 tx=0x7f5f4400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400ccc0 con 0x7f5f500731e0 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f4400ee50 con 0x7f5f500731e0 2024-09-10T11:39:53.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f50156a90 con 0x7f5f500731e0 2024-09-10T11:39:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44010670 con 0x7f5f500731e0 2024-09-10T11:39:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.488+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f50157050 con 0x7f5f500731e0 2024-09-10T11:39:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.490+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f50070760 con 0x7f5f500731e0 2024-09-10T11:39:53.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.491+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f5f44010810 con 0x7f5f500731e0 2024-09-10T11:39:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.491+0000 7f5f4d7fa640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5f340750a0 0x7f5f34077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.492+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5f44096cf0 con 0x7f5f500731e0 2024-09-10T11:39:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.492+0000 7f5f4ffff640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5f340750a0 0x7f5f34077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.492+0000 7f5f4ffff640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5f340750a0 0x7f5f34077560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f501f3590 tx=0x7f5f3c005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.496+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f5f50070760 con 0x7f5f500731e0 2024-09-10T11:39:53.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.742+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5f500735c0 con 0x7f5f500731e0 2024-09-10T11:39:53.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.742+0000 7f5f4d7fa640 1 -- 172.21.15.57:0/1213618538 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f5f44060980 con 0x7f5f500731e0 2024-09-10T11:39:53.743 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:53.744 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5f340750a0 msgr2=0x7f5f34077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5f340750a0 0x7f5f34077560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f501f3590 tx=0x7f5f3c005f90 comp rx=0 tx=0).stop 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 msgr2=0x7f5f5014f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 0x7f5f5014f530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e740 tx=0x7f5f4400ec00 comp rx=0 tx=0).stop 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 shutdown_connections 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5f340750a0 0x7f5f34077560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f5015e580 0x7f5f501f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f500b3a00 0x7f5f501f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 --2- 172.21.15.57:0/1213618538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f500731e0 0x7f5f5014f530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 >> 172.21.15.57:0/1213618538 conn(0x7f5f500d0a90 msgr2=0x7f5f500cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.745+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 shutdown_connections 2024-09-10T11:39:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:53.746+0000 7f5f56fca640 1 -- 172.21.15.57:0/1213618538 wait complete. 2024-09-10T11:39:56.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:39:56.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.873+0000 7f270a994640 1 -- 172.21.15.57:0/1457831714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270415e1d0 msgr2=0x7f27040ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:56.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.874+0000 7f270a994640 1 --2- 172.21.15.57:0/1457831714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270415e1d0 0x7f27040ceae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009830 tx=0x7f26f402a5c0 comp rx=0 tx=0).stop 2024-09-10T11:39:56.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.874+0000 7f270a994640 1 -- 172.21.15.57:0/1457831714 shutdown_connections 2024-09-10T11:39:56.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.874+0000 7f270a994640 1 --2- 172.21.15.57:0/1457831714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270415e1d0 0x7f27040ceae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:56.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.874+0000 7f270a994640 1 -- 172.21.15.57:0/1457831714 >> 172.21.15.57:0/1457831714 conn(0x7f27040d3dc0 msgr2=0x7f27040d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:56.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.874+0000 7f270a994640 1 -- 172.21.15.57:0/1457831714 shutdown_connections 2024-09-10T11:39:56.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.874+0000 7f270a994640 1 -- 172.21.15.57:0/1457831714 wait complete. 2024-09-10T11:39:56.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.875+0000 7f270a994640 1 Processor -- start 2024-09-10T11:39:56.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.876+0000 7f270a994640 1 -- start start 2024-09-10T11:39:56.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f270a994640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27040cf730 0x7f270406e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f270a994640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 0x7f27041f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f270a994640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27041f87a0 0x7f2704154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f270a994640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2704160de0 con 0x7f27040d48e0 2024-09-10T11:39:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f270a994640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2704160c60 con 0x7f27041f87a0 2024-09-10T11:39:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f270a994640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2704160f60 con 0x7f27040cf730 2024-09-10T11:39:56.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f27037fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 0x7f27041f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f27037fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 0x7f27041f8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59852/0 (socket says 172.21.15.57:59852) 2024-09-10T11:39:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f27037fe640 1 -- 172.21.15.57:0/2594522759 learned_addr learned my addr 172.21.15.57:0/2594522759 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:39:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f2708f31640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27041f87a0 0x7f2704154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f2703fff640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27040cf730 0x7f270406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f27037fe640 1 -- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27040cf730 msgr2=0x7f270406e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:56.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.877+0000 7f27037fe640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27040cf730 0x7f270406e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:56.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f27037fe640 1 -- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27041f87a0 msgr2=0x7f2704154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:56.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f27037fe640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27041f87a0 0x7f2704154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:56.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f27037fe640 1 -- 172.21.15.57:0/2594522759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27041f8c70 con 0x7f27040d48e0 2024-09-10T11:39:56.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f27037fe640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 0x7f27041f8260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c490 tx=0x7f26f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:56.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80052d0 con 0x7f27040d48e0 2024-09-10T11:39:56.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26f8005490 con 0x7f27040d48e0 2024-09-10T11:39:56.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27041f8f50 con 0x7f27040d48e0 2024-09-10T11:39:56.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.878+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27040b39a0 con 0x7f27040d48e0 2024-09-10T11:39:56.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.879+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8012890 con 0x7f27040d48e0 2024-09-10T11:39:56.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.879+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e4005290 con 0x7f27040d48e0 2024-09-10T11:39:56.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.881+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f26f8012a30 con 0x7f27040d48e0 2024-09-10T11:39:56.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.881+0000 7f2700ff9640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26f00750a0 0x7f26f0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:39:56.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.882+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f26f8095d90 con 0x7f27040d48e0 2024-09-10T11:39:56.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.882+0000 7f2703fff640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26f00750a0 0x7f26f0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:39:56.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.882+0000 7f2703fff640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26f00750a0 0x7f26f0077560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26f4034000 tx=0x7f26f4004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:39:56.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:56.885+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f26f8099030 con 0x7f27040d48e0 2024-09-10T11:39:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.183+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26e4005580 con 0x7f27040d48e0 2024-09-10T11:39:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.183+0000 7f2700ff9640 1 -- 172.21.15.57:0/2594522759 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f26f805fa20 con 0x7f27040d48e0 2024-09-10T11:39:57.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:39:57.185 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:39:57.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26f00750a0 msgr2=0x7f26f0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26f00750a0 0x7f26f0077560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26f4034000 tx=0x7f26f4004730 comp rx=0 tx=0).stop 2024-09-10T11:39:57.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 msgr2=0x7f27041f8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 0x7f27041f8260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c490 tx=0x7f26f800c950 comp rx=0 tx=0).stop 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 shutdown_connections 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f26f00750a0 0x7f26f0077560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27041f87a0 0x7f2704154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27040d48e0 0x7f27041f8260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 --2- 172.21.15.57:0/2594522759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27040cf730 0x7f270406e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 >> 172.21.15.57:0/2594522759 conn(0x7f27040d3dc0 msgr2=0x7f27040ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 shutdown_connections 2024-09-10T11:39:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:39:57.186+0000 7f270a994640 1 -- 172.21.15.57:0/2594522759 wait complete. 2024-09-10T11:40:00.201 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.346+0000 7fc22ef24640 1 -- 172.21.15.57:0/2039992635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 msgr2=0x7fc2280cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.346+0000 7fc22ef24640 1 --2- 172.21.15.57:0/2039992635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 0x7fc2280cf690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0098e0 tx=0x7fc21c02a5b0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.346+0000 7fc22ef24640 1 -- 172.21.15.57:0/2039992635 shutdown_connections 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.346+0000 7fc22ef24640 1 --2- 172.21.15.57:0/2039992635 >> v2:172.21.15.154:3300/0 conn(0x7fc2280cfe70 0x7fc2280d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.347+0000 7fc22ef24640 1 --2- 172.21.15.57:0/2039992635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 0x7fc2280cf690 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.347+0000 7fc22ef24640 1 -- 172.21.15.57:0/2039992635 >> 172.21.15.57:0/2039992635 conn(0x7fc2280d1ac0 msgr2=0x7fc2280d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.347+0000 7fc22ef24640 1 -- 172.21.15.57:0/2039992635 shutdown_connections 2024-09-10T11:40:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.347+0000 7fc22ef24640 1 -- 172.21.15.57:0/2039992635 wait complete. 2024-09-10T11:40:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.348+0000 7fc22ef24640 1 Processor -- start 2024-09-10T11:40:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.348+0000 7fc22ef24640 1 -- start start 2024-09-10T11:40:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.349+0000 7fc22ef24640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2280ce4d0 0x7fc22809cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.349+0000 7fc22ef24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 0x7fc2281f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.349+0000 7fc22ef24640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 0x7fc2281f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.349+0000 7fc22ef24640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc2280d28d0 con 0x7fc2280ce4d0 2024-09-10T11:40:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.349+0000 7fc22ef24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2280d2750 con 0x7fc2280cfe70 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.349+0000 7fc22ef24640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc2280cf090 con 0x7fc22815bbb0 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 0x7fc2281f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 0x7fc2281f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:43628/0 (socket says 172.21.15.57:43628) 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 -- 172.21.15.57:0/3578127184 learned_addr learned my addr 172.21.15.57:0/3578127184 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc22d4c1640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 0x7fc2281f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc22ccc0640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2280ce4d0 0x7fc22809cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 -- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 msgr2=0x7fc2281f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 0x7fc2281f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 -- 172.21.15.57:0/3578127184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2280ce4d0 msgr2=0x7fc22809cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2280ce4d0 0x7fc22809cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 -- 172.21.15.57:0/3578127184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2281f8060 con 0x7fc2280cfe70 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc227fff640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 0x7fc2281f7760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc21400e9c0 tx=0x7fc21400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21400cde0 con 0x7fc2280cfe70 2024-09-10T11:40:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc214010520 con 0x7fc2280cfe70 2024-09-10T11:40:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2281f8340 con 0x7fc2280cfe70 2024-09-10T11:40:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.350+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214010970 con 0x7fc2280cfe70 2024-09-10T11:40:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.351+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2281f4280 con 0x7fc2280cfe70 2024-09-10T11:40:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.352+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2280b62a0 con 0x7fc2280cfe70 2024-09-10T11:40:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.352+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fc214010b10 con 0x7fc2280cfe70 2024-09-10T11:40:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.353+0000 7fc2257fa640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc20c0750a0 0x7fc20c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.353+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc214096dc0 con 0x7fc2280cfe70 2024-09-10T11:40:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.353+0000 7fc22ccc0640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc20c0750a0 0x7fc20c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.354+0000 7fc22ccc0640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc20c0750a0 0x7fc20c077560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc21c034000 tx=0x7fc21c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:00.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.357+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fc214060ae0 con 0x7fc2280cfe70 2024-09-10T11:40:00.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:40:00.434 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:40:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.732+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc228075e10 con 0x7fc2280cfe70 2024-09-10T11:40:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.733+0000 7fc2257fa640 1 -- 172.21.15.57:0/3578127184 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc2140652a0 con 0x7fc2280cfe70 2024-09-10T11:40:00.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:00.734 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.736+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc20c0750a0 msgr2=0x7fc20c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.736+0000 7fc22ef24640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc20c0750a0 0x7fc20c077560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc21c034000 tx=0x7fc21c004730 comp rx=0 tx=0).stop 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.736+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 msgr2=0x7fc2281f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.736+0000 7fc22ef24640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 0x7fc2281f7760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc21400e9c0 tx=0x7fc21400ee80 comp rx=0 tx=0).stop 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 shutdown_connections 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc20c0750a0 0x7fc20c077560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc22815bbb0 0x7fc2281f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2280cfe70 0x7fc2281f7760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 --2- 172.21.15.57:0/3578127184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2280ce4d0 0x7fc22809cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 >> 172.21.15.57:0/3578127184 conn(0x7fc2280d1ac0 msgr2=0x7fc2280b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 shutdown_connections 2024-09-10T11:40:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:00.737+0000 7fc22ef24640 1 -- 172.21.15.57:0/3578127184 wait complete. 2024-09-10T11:40:03.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 -- 172.21.15.57:0/20537105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 msgr2=0x7ffa6c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 --2- 172.21.15.57:0/20537105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c0cabc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa60005fd0 tx=0x7ffa6002a5d0 comp rx=0 tx=0).stop 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 -- 172.21.15.57:0/20537105 shutdown_connections 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 --2- 172.21.15.57:0/20537105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6c0732a0 0x7ffa6c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 --2- 172.21.15.57:0/20537105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c0cabc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 -- 172.21.15.57:0/20537105 >> 172.21.15.57:0/20537105 conn(0x7ffa6c0ccc20 msgr2=0x7ffa6c0cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 -- 172.21.15.57:0/20537105 shutdown_connections 2024-09-10T11:40:03.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.879+0000 7ffa72f75640 1 -- 172.21.15.57:0/20537105 wait complete. 2024-09-10T11:40:03.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.881+0000 7ffa72f75640 1 Processor -- start 2024-09-10T11:40:03.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.881+0000 7ffa72f75640 1 -- start start 2024-09-10T11:40:03.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa72f75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 0x7ffa6c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:03.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa72f75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6c0cb200 0x7ffa6c1f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa72f75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c1f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa72f75640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0cedb0 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa72f75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0cec30 con 0x7ffa6c0732a0 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa72f75640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c0cef30 con 0x7ffa6c0cb200 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa71512640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c1f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa70d11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 0x7ffa6c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa71512640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c1f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40828/0 (socket says 172.21.15.57:40828) 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa70d11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 0x7ffa6c06ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:43642/0 (socket says 172.21.15.57:43642) 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa71512640 1 -- 172.21.15.57:0/37815137 learned_addr learned my addr 172.21.15.57:0/37815137 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.882+0000 7ffa6bfff640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6c0cb200 0x7ffa6c1f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa71512640 1 -- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6c0cb200 msgr2=0x7ffa6c1f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa71512640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6c0cb200 0x7ffa6c1f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:03.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa71512640 1 -- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 msgr2=0x7ffa6c06ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:03.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa71512640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 0x7ffa6c06ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:03.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa71512640 1 -- 172.21.15.57:0/37815137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c1f88c0 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa70d11640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 0x7ffa6c06ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:03.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa71512640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c1f3dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400eb40 tx=0x7ffa6400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:03.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004b20 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa64004ce0 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c0ad9a0 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64005280 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.883+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c0adf60 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.884+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c0b6090 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.886+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7ffa64005420 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.886+0000 7ffa697fa640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ffa500750a0 0x7ffa50077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:03.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.886+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ffa64096f90 con 0x7ffa6c15e0a0 2024-09-10T11:40:03.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.886+0000 7ffa70d11640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ffa500750a0 0x7ffa50077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:03.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.887+0000 7ffa70d11640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ffa500750a0 0x7ffa50077560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa60033000 tx=0x7ffa60004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:03.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:03.892+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7ffa64060c30 con 0x7ffa6c15e0a0 2024-09-10T11:40:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.210+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa6c0ce460 con 0x7ffa6c15e0a0 2024-09-10T11:40:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.210+0000 7ffa697fa640 1 -- 172.21.15.57:0/37815137 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ffa640653f0 con 0x7ffa6c15e0a0 2024-09-10T11:40:04.211 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:04.212 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:04.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.212+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ffa500750a0 msgr2=0x7ffa50077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.212+0000 7ffa72f75640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ffa500750a0 0x7ffa50077560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa60033000 tx=0x7ffa60004730 comp rx=0 tx=0).stop 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.212+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 msgr2=0x7ffa6c1f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.212+0000 7ffa72f75640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c1f3dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400eb40 tx=0x7ffa6400c2d0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 shutdown_connections 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ffa500750a0 0x7ffa50077560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa6c15e0a0 0x7ffa6c1f3dc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6c0cb200 0x7ffa6c1f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 --2- 172.21.15.57:0/37815137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6c0732a0 0x7ffa6c06ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 >> 172.21.15.57:0/37815137 conn(0x7ffa6c0ccc20 msgr2=0x7ffa6c0cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 shutdown_connections 2024-09-10T11:40:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:04.213+0000 7ffa72f75640 1 -- 172.21.15.57:0/37815137 wait complete. 2024-09-10T11:40:07.228 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 -- 172.21.15.57:0/3065827375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c415e1d0 msgr2=0x7ff3c40ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/3065827375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c415e1d0 0x7ff3c40ceae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009830 tx=0x7ff3b402a510 comp rx=0 tx=0).stop 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 -- 172.21.15.57:0/3065827375 shutdown_connections 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/3065827375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3c40d48e0 0x7ff3c40cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/3065827375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c415e1d0 0x7ff3c40ceae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 -- 172.21.15.57:0/3065827375 >> 172.21.15.57:0/3065827375 conn(0x7ff3c40d3dc0 msgr2=0x7ff3c40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 -- 172.21.15.57:0/3065827375 shutdown_connections 2024-09-10T11:40:07.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.369+0000 7ff3c88a2640 1 -- 172.21.15.57:0/3065827375 wait complete. 2024-09-10T11:40:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.370+0000 7ff3c88a2640 1 Processor -- start 2024-09-10T11:40:07.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.370+0000 7ff3c88a2640 1 -- start start 2024-09-10T11:40:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c88a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40cf560 0x7ff3c40c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c88a2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 0x7ff3c40b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c88a2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3c41f8170 0x7ff3c40b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c88a2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c415f060 con 0x7ff3c40d48e0 2024-09-10T11:40:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c88a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c415eee0 con 0x7ff3c40cf560 2024-09-10T11:40:07.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c88a2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c415f1e0 con 0x7ff3c41f8170 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 0x7ff3c40b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3bbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 0x7ff3c40b8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40842/0 (socket says 172.21.15.57:40842) 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3bbfff640 1 -- 172.21.15.57:0/2463481843 learned_addr learned my addr 172.21.15.57:0/2463481843 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c259c640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40cf560 0x7ff3c40c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.371+0000 7ff3c2d9d640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3c41f8170 0x7ff3c40b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3bbfff640 1 -- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3c41f8170 msgr2=0x7ff3c40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3bbfff640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3c41f8170 0x7ff3c40b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3bbfff640 1 -- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40cf560 msgr2=0x7ff3c40c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3bbfff640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40cf560 0x7ff3c40c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3bbfff640 1 -- 172.21.15.57:0/2463481843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c41f4b80 con 0x7ff3c40d48e0 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3c259c640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40cf560 0x7ff3c40c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3bbfff640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 0x7ff3c40b8720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00ea60 tx=0x7ff3ac00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00cde0 con 0x7ff3c40d48e0 2024-09-10T11:40:07.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3ac004020 con 0x7ff3c40d48e0 2024-09-10T11:40:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac004450 con 0x7ff3c40d48e0 2024-09-10T11:40:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c40c9d10 con 0x7ff3c40d48e0 2024-09-10T11:40:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.372+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41f8950 con 0x7ff3c40d48e0 2024-09-10T11:40:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.374+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c41618a0 con 0x7ff3c40d48e0 2024-09-10T11:40:07.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.374+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7ff3ac0035f0 con 0x7ff3c40d48e0 2024-09-10T11:40:07.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.375+0000 7ff3baffd640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff3a40750a0 0x7ff3a4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:07.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.375+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff3ac096d80 con 0x7ff3c40d48e0 2024-09-10T11:40:07.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.375+0000 7ff3c259c640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff3a40750a0 0x7ff3a4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:07.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.376+0000 7ff3c259c640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff3a40750a0 0x7ff3a4077560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4034000 tx=0x7ff3b4004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:07.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.379+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7ff3c41f4b80 con 0x7ff3c40d48e0 2024-09-10T11:40:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.635+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff3c40b3320 con 0x7ff3c40d48e0 2024-09-10T11:40:07.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.635+0000 7ff3baffd640 1 -- 172.21.15.57:0/2463481843 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ff3ac060990 con 0x7ff3c40d48e0 2024-09-10T11:40:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:07.637 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff3a40750a0 msgr2=0x7ff3a4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff3a40750a0 0x7ff3a4077560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4034000 tx=0x7ff3b4004730 comp rx=0 tx=0).stop 2024-09-10T11:40:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 msgr2=0x7ff3c40b8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 0x7ff3c40b8720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00ea60 tx=0x7ff3ac00ef20 comp rx=0 tx=0).stop 2024-09-10T11:40:07.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 shutdown_connections 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff3a40750a0 0x7ff3a4077560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3c41f8170 0x7ff3c40b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c40d48e0 0x7ff3c40b8720 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 --2- 172.21.15.57:0/2463481843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3c40cf560 0x7ff3c40c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 >> 172.21.15.57:0/2463481843 conn(0x7ff3c40d3dc0 msgr2=0x7ff3c40b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 shutdown_connections 2024-09-10T11:40:07.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:07.638+0000 7ff3c88a2640 1 -- 172.21.15.57:0/2463481843 wait complete. 2024-09-10T11:40:10.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:10.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 -- 172.21.15.57:0/3156028863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3401611b0 msgr2=0x7fb340168b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:10.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 --2- 172.21.15.57:0/3156028863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3401611b0 0x7fb340168b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb338005fd0 tx=0x7fb33802ab40 comp rx=0 tx=0).stop 2024-09-10T11:40:10.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 -- 172.21.15.57:0/3156028863 shutdown_connections 2024-09-10T11:40:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 --2- 172.21.15.57:0/3156028863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3401611b0 0x7fb340168b70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 -- 172.21.15.57:0/3156028863 >> 172.21.15.57:0/3156028863 conn(0x7fb3400d3dc0 msgr2=0x7fb3400d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 -- 172.21.15.57:0/3156028863 shutdown_connections 2024-09-10T11:40:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.779+0000 7fb348524640 1 -- 172.21.15.57:0/3156028863 wait complete. 2024-09-10T11:40:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.781+0000 7fb348524640 1 Processor -- start 2024-09-10T11:40:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.781+0000 7fb348524640 1 -- start start 2024-09-10T11:40:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb348524640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 0x7fb3400b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb348524640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3401611b0 0x7fb340157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb348524640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3400b7790 0x7fb34006e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb348524640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb340169440 con 0x7fb3400d48e0 2024-09-10T11:40:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb348524640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401692c0 con 0x7fb3400b7790 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb348524640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb3401695c0 con 0x7fb3401611b0 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 0x7fb3400b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 0x7fb3400b93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51094/0 (socket says 172.21.15.57:51094) 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 -- 172.21.15.57:0/2947912516 learned_addr learned my addr 172.21.15.57:0/2947912516 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb346ac1640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3400b7790 0x7fb34006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb345abf640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3401611b0 0x7fb340157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 -- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3401611b0 msgr2=0x7fb340157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3401611b0 0x7fb340157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 -- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3400b7790 msgr2=0x7fb34006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.782+0000 7fb3462c0640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3400b7790 0x7fb34006e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb3462c0640 1 -- 172.21.15.57:0/2947912516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3401f5e10 con 0x7fb3400d48e0 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb346ac1640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3400b7790 0x7fb34006e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb3462c0640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 0x7fb3400b93c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c450 tx=0x7fb33c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0052d0 con 0x7fb3400d48e0 2024-09-10T11:40:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb33c005470 con 0x7fb3400d48e0 2024-09-10T11:40:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3400b9a30 con 0x7fb3400d48e0 2024-09-10T11:40:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c012870 con 0x7fb3400d48e0 2024-09-10T11:40:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.783+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3401f63b0 con 0x7fb3400d48e0 2024-09-10T11:40:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.784+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3400ceae0 con 0x7fb3400d48e0 2024-09-10T11:40:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.785+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb33c0035f0 con 0x7fb3400d48e0 2024-09-10T11:40:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.786+0000 7fb336ffd640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3240750a0 0x7fb324077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.786+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb33c095cf0 con 0x7fb3400d48e0 2024-09-10T11:40:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.786+0000 7fb345abf640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3240750a0 0x7fb324077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.786+0000 7fb345abf640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3240750a0 0x7fb324077560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb340169080 tx=0x7fb330009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:10.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:10.791+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb33c05fa10 con 0x7fb3400d48e0 2024-09-10T11:40:11.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.060+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3400b3320 con 0x7fb3400d48e0 2024-09-10T11:40:11.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.061+0000 7fb336ffd640 1 -- 172.21.15.57:0/2947912516 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb33c0641d0 con 0x7fb3400d48e0 2024-09-10T11:40:11.063 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:11.063 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3240750a0 msgr2=0x7fb324077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3240750a0 0x7fb324077560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb340169080 tx=0x7fb330009040 comp rx=0 tx=0).stop 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 msgr2=0x7fb3400b93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 0x7fb3400b93c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c450 tx=0x7fb33c00c910 comp rx=0 tx=0).stop 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 shutdown_connections 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3240750a0 0x7fb324077560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3400b7790 0x7fb34006e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3401611b0 0x7fb340157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:11.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 --2- 172.21.15.57:0/2947912516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3400d48e0 0x7fb3400b93c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:11.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 >> 172.21.15.57:0/2947912516 conn(0x7fb3400d3dc0 msgr2=0x7fb3400b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:11.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 shutdown_connections 2024-09-10T11:40:11.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:11.064+0000 7fb348524640 1 -- 172.21.15.57:0/2947912516 wait complete. 2024-09-10T11:40:14.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:14.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.223+0000 7fd439917640 1 -- 172.21.15.57:0/3422472329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340d48e0 msgr2=0x7fd4340cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.223+0000 7fd439917640 1 --2- 172.21.15.57:0/3422472329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340d48e0 0x7fd4340cf020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd428009830 tx=0x7fd42802a510 comp rx=0 tx=0).stop 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.223+0000 7fd439917640 1 -- 172.21.15.57:0/3422472329 shutdown_connections 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.223+0000 7fd439917640 1 --2- 172.21.15.57:0/3422472329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340d48e0 0x7fd4340cf020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.224+0000 7fd439917640 1 --2- 172.21.15.57:0/3422472329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43415e1d0 0x7fd4340ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.224+0000 7fd439917640 1 -- 172.21.15.57:0/3422472329 >> 172.21.15.57:0/3422472329 conn(0x7fd4340d3dc0 msgr2=0x7fd4340d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.224+0000 7fd439917640 1 -- 172.21.15.57:0/3422472329 shutdown_connections 2024-09-10T11:40:14.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.224+0000 7fd439917640 1 -- 172.21.15.57:0/3422472329 wait complete. 2024-09-10T11:40:14.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.225+0000 7fd439917640 1 Processor -- start 2024-09-10T11:40:14.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.225+0000 7fd439917640 1 -- start start 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd439917640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf560 0x7fd4341f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd439917640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 0x7fd4340b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd439917640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4340b7130 0x7fd4340cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd439917640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd43415f060 con 0x7fd4340d48e0 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd439917640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd43415eee0 con 0x7fd4340cf560 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd439917640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd43415f1e0 con 0x7fd4340b7130 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 0x7fd4340b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd432ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf560 0x7fd4341f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 0x7fd4340b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51108/0 (socket says 172.21.15.57:51108) 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 -- 172.21.15.57:0/1918113470 learned_addr learned my addr 172.21.15.57:0/1918113470 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:14.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4337fe640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4340b7130 0x7fd4340cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 -- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4340b7130 msgr2=0x7fd4340cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4340b7130 0x7fd4340cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 -- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf560 msgr2=0x7fd4341f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf560 0x7fd4341f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 -- 172.21.15.57:0/1918113470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340cbca0 con 0x7fd4340d48e0 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd432ffd640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf560 0x7fd4341f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.227+0000 7fd4327fc640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 0x7fd4340b6bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd428009950 tx=0x7fd428032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.228+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428040070 con 0x7fd4340d48e0 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.228+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4280038e0 con 0x7fd4340d48e0 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.228+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428005c90 con 0x7fd4340d48e0 2024-09-10T11:40:14.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.228+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4340cb9c0 con 0x7fd4340d48e0 2024-09-10T11:40:14.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.228+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4340cce30 con 0x7fd4340d48e0 2024-09-10T11:40:14.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.229+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4340c7750 con 0x7fd4340d48e0 2024-09-10T11:40:14.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.230+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd428039040 con 0x7fd4340d48e0 2024-09-10T11:40:14.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.230+0000 7fd41bfff640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd4200750a0 0x7fd420077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:14.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.231+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd4280b77b0 con 0x7fd4340d48e0 2024-09-10T11:40:14.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.231+0000 7fd432ffd640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd4200750a0 0x7fd420077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:14.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.231+0000 7fd432ffd640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd4200750a0 0x7fd420077560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd4340cc800 tx=0x7fd424005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:14.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.236+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd4280813a0 con 0x7fd4340d48e0 2024-09-10T11:40:14.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.555+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4341618a0 con 0x7fd4340d48e0 2024-09-10T11:40:14.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.556+0000 7fd41bfff640 1 -- 172.21.15.57:0/1918113470 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd428085b60 con 0x7fd4340d48e0 2024-09-10T11:40:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd4200750a0 msgr2=0x7fd420077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd4200750a0 0x7fd420077560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd4340cc800 tx=0x7fd424005f90 comp rx=0 tx=0).stop 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 msgr2=0x7fd4340b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 0x7fd4340b6bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd428009950 tx=0x7fd428032c10 comp rx=0 tx=0).stop 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 shutdown_connections 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd4200750a0 0x7fd420077560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4340b7130 0x7fd4340cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4340d48e0 0x7fd4340b6bf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 --2- 172.21.15.57:0/1918113470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf560 0x7fd4341f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 >> 172.21.15.57:0/1918113470 conn(0x7fd4340d3dc0 msgr2=0x7fd4340d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 shutdown_connections 2024-09-10T11:40:14.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:14.559+0000 7fd439917640 1 -- 172.21.15.57:0/1918113470 wait complete. 2024-09-10T11:40:17.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.697+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/3247001126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 msgr2=0x7f7c880aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.697+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/3247001126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c880aff20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c80005fd0 tx=0x7f7c8002a940 comp rx=0 tx=0).stop 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.697+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/3247001126 shutdown_connections 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.697+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/3247001126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c880aff20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.697+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/3247001126 >> 172.21.15.57:0/3247001126 conn(0x7f7c880d0a60 msgr2=0x7f7c880d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.698+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/3247001126 shutdown_connections 2024-09-10T11:40:17.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.698+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/3247001126 wait complete. 2024-09-10T11:40:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.699+0000 7f7c8e6c8640 1 Processor -- start 2024-09-10T11:40:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.699+0000 7f7c8e6c8640 1 -- start start 2024-09-10T11:40:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8e6c8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 0x7f7c881f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8e6c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c8814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:17.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8e6c8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8815a920 0x7f7c880c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8e6c8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8806fc20 con 0x7f7c8806e0f0 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8e6c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8806faa0 con 0x7f7c880afa40 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8e6c8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8815eef0 con 0x7f7c8815a920 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c87fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 0x7f7c881f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c87fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 0x7f7c881f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51116/0 (socket says 172.21.15.57:51116) 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c87fff640 1 -- 172.21.15.57:0/752109232 learned_addr learned my addr 172.21.15.57:0/752109232 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c877fe640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c8814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.700+0000 7f7c8cc65640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8815a920 0x7f7c880c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c87fff640 1 -- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8815a920 msgr2=0x7f7c880c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c87fff640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8815a920 0x7f7c880c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c87fff640 1 -- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 msgr2=0x7f7c8814beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c87fff640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c8814beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c87fff640 1 -- 172.21.15.57:0/752109232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c88158aa0 con 0x7f7c8806e0f0 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c877fe640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c8814beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c87fff640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 0x7f7c881f6080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c3c0 tx=0x7f7c7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78017070 con 0x7f7c8806e0f0 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c780035f0 con 0x7f7c8806e0f0 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c881f6f90 con 0x7f7c8806e0f0 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c78003a20 con 0x7f7c8806e0f0 2024-09-10T11:40:17.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.701+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c881f69d0 con 0x7f7c8806e0f0 2024-09-10T11:40:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.703+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c880aff20 con 0x7f7c8806e0f0 2024-09-10T11:40:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.703+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f7c7801a070 con 0x7f7c8806e0f0 2024-09-10T11:40:17.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.704+0000 7f7c84ff9640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7c740750a0 0x7f7c74077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.704+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7c78095560 con 0x7f7c8806e0f0 2024-09-10T11:40:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.704+0000 7f7c877fe640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7c740750a0 0x7f7c74077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:17.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.705+0000 7f7c877fe640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7c740750a0 0x7f7c74077560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c000c00 tx=0x7f7c7c009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:17.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.711+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f7c7805f280 con 0x7f7c8806e0f0 2024-09-10T11:40:17.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.919+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7c880cbc30 con 0x7f7c8806e0f0 2024-09-10T11:40:17.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.920+0000 7f7c84ff9640 1 -- 172.21.15.57:0/752109232 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f7c78063a40 con 0x7f7c8806e0f0 2024-09-10T11:40:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:17.922 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.922+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7c740750a0 msgr2=0x7f7c74077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.922+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7c740750a0 0x7f7c74077560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c000c00 tx=0x7f7c7c009040 comp rx=0 tx=0).stop 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.922+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 msgr2=0x7f7c881f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.922+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 0x7f7c881f6080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c3c0 tx=0x7f7c7800c880 comp rx=0 tx=0).stop 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 shutdown_connections 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7c740750a0 0x7f7c74077560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8815a920 0x7f7c880c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c880afa40 0x7f7c8814beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 --2- 172.21.15.57:0/752109232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c8806e0f0 0x7f7c881f6080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 >> 172.21.15.57:0/752109232 conn(0x7f7c880d0a60 msgr2=0x7f7c8806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:17.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 shutdown_connections 2024-09-10T11:40:17.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:17.923+0000 7f7c8e6c8640 1 -- 172.21.15.57:0/752109232 wait complete. 2024-09-10T11:40:20.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:21.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 -- 172.21.15.57:0/1195753516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40d48e0 msgr2=0x7f62e40cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:21.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 --2- 172.21.15.57:0/1195753516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40d48e0 0x7f62e40cf020 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62e40d0490 tx=0x7f62cc02a560 comp rx=0 tx=0).stop 2024-09-10T11:40:21.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 -- 172.21.15.57:0/1195753516 shutdown_connections 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 --2- 172.21.15.57:0/1195753516 >> v2:172.21.15.154:3300/0 conn(0x7f62e40cf560 0x7f62e415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 --2- 172.21.15.57:0/1195753516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40d48e0 0x7f62e40cf020 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 --2- 172.21.15.57:0/1195753516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e415e1d0 0x7f62e40ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 -- 172.21.15.57:0/1195753516 >> 172.21.15.57:0/1195753516 conn(0x7f62e40d3dc0 msgr2=0x7f62e40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 -- 172.21.15.57:0/1195753516 shutdown_connections 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.085+0000 7f62e960f640 1 -- 172.21.15.57:0/1195753516 wait complete. 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.087+0000 7f62e960f640 1 Processor -- start 2024-09-10T11:40:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.087+0000 7f62e960f640 1 -- start start 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e960f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 0x7f62e40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e960f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 0x7f62e40b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e960f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40b8d40 0x7f62e41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e960f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f62e415f130 con 0x7f62e40b8d40 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e960f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62e415efb0 con 0x7f62e40cf560 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e960f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f62e415f2b0 con 0x7f62e40d48e0 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 0x7f62e40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 0x7f62e40b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 0x7f62e40b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:51678/0 (socket says 172.21.15.57:51678) 2024-09-10T11:40:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 0x7f62e40b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:37258/0 (socket says 172.21.15.57:37258) 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e2ffd640 1 -- 172.21.15.57:0/3079033210 learned_addr learned my addr 172.21.15.57:0/3079033210 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e37fe640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40b8d40 0x7f62e41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 -- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 msgr2=0x7f62e40b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 0x7f62e40b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 -- 172.21.15.57:0/3079033210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40b8d40 msgr2=0x7f62e41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40b8d40 0x7f62e41572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62dbfff640 1 -- 172.21.15.57:0/3079033210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e40b6e40 con 0x7f62e40d48e0 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.088+0000 7f62e2ffd640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 0x7f62e40b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.089+0000 7f62dbfff640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 0x7f62e40b8800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f62cc031000 tx=0x7f62cc005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.089+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc03f070 con 0x7f62e40d48e0 2024-09-10T11:40:21.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.089+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62cc0035f0 con 0x7f62e40d48e0 2024-09-10T11:40:21.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.089+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e40b7120 con 0x7f62e40d48e0 2024-09-10T11:40:21.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.089+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc035030 con 0x7f62e40d48e0 2024-09-10T11:40:21.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.089+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e40b76e0 con 0x7f62e40d48e0 2024-09-10T11:40:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.091+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e40b9150 con 0x7f62e40d48e0 2024-09-10T11:40:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.091+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f62cc042070 con 0x7f62e40d48e0 2024-09-10T11:40:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.092+0000 7f62db7fe640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f62c40750a0 0x7f62c4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.092+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f62cc0b7520 con 0x7f62e40d48e0 2024-09-10T11:40:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.092+0000 7f62e2ffd640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f62c40750a0 0x7f62c4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:21.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.092+0000 7f62e2ffd640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f62c40750a0 0x7f62c4077560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009fd0 tx=0x7f62d4005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:21.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.097+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f62cc081220 con 0x7f62e40d48e0 2024-09-10T11:40:21.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.388+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62e41618a0 con 0x7f62e40d48e0 2024-09-10T11:40:21.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.388+0000 7f62db7fe640 1 -- 172.21.15.57:0/3079033210 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f62cc0859e0 con 0x7f62e40d48e0 2024-09-10T11:40:21.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:21.391 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:21.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f62c40750a0 msgr2=0x7f62c4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:21.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f62c40750a0 0x7f62c4077560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009fd0 tx=0x7f62d4005f90 comp rx=0 tx=0).stop 2024-09-10T11:40:21.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 msgr2=0x7f62e40b8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:21.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 0x7f62e40b8800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f62cc031000 tx=0x7f62cc005770 comp rx=0 tx=0).stop 2024-09-10T11:40:21.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 shutdown_connections 2024-09-10T11:40:21.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f62c40750a0 0x7f62c4077560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62e40b8d40 0x7f62e41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e40d48e0 0x7f62e40b8800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 --2- 172.21.15.57:0/3079033210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e40cf560 0x7f62e40b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:21.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 >> 172.21.15.57:0/3079033210 conn(0x7f62e40d3dc0 msgr2=0x7f62e40b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:21.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 shutdown_connections 2024-09-10T11:40:21.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:21.391+0000 7f62e960f640 1 -- 172.21.15.57:0/3079033210 wait complete. 2024-09-10T11:40:24.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:24.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 -- 172.21.15.57:0/4234503423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 msgr2=0x7feee015c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:24.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 --2- 172.21.15.57:0/4234503423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee015c610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feedc009830 tx=0x7feedc02a520 comp rx=0 tx=0).stop 2024-09-10T11:40:24.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 -- 172.21.15.57:0/4234503423 shutdown_connections 2024-09-10T11:40:24.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 --2- 172.21.15.57:0/4234503423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee015c610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 -- 172.21.15.57:0/4234503423 >> 172.21.15.57:0/4234503423 conn(0x7feee00b55c0 msgr2=0x7feee00b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:24.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 -- 172.21.15.57:0/4234503423 shutdown_connections 2024-09-10T11:40:24.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.537+0000 7feee755d640 1 -- 172.21.15.57:0/4234503423 wait complete. 2024-09-10T11:40:24.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.540+0000 7feee755d640 1 Processor -- start 2024-09-10T11:40:24.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.540+0000 7feee755d640 1 -- start start 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.541+0000 7feee755d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 0x7feee009dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.541+0000 7feee755d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feee0074540 0x7feee009b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.541+0000 7feee755d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee01f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.541+0000 7feee755d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7feee00b4ad0 con 0x7feee0068610 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.541+0000 7feee755d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feee00b4950 con 0x7feee015c230 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.541+0000 7feee755d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7feee00b4c50 con 0x7feee0074540 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee52f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 0x7feee009dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee01f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee52f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 0x7feee009dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36218/0 (socket says 172.21.15.57:36218) 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee52f9640 1 -- 172.21.15.57:0/10887983 learned_addr learned my addr 172.21.15.57:0/10887983 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:24.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee4af8640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feee0074540 0x7feee009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 -- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feee0074540 msgr2=0x7feee009b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feee0074540 0x7feee009b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 -- 172.21.15.57:0/10887983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 msgr2=0x7feee009dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 0x7feee009dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 -- 172.21.15.57:0/10887983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee009cfe0 con 0x7feee015c230 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee52f9640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 0x7feee009dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:24.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee5afa640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee01f5a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed800cae0 tx=0x7feed800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8016020 con 0x7feee015c230 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feed800acf0 con 0x7feee015c230 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8012680 con 0x7feee015c230 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.542+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee009cd00 con 0x7feee015c230 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.543+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee009af20 con 0x7feee015c230 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.544+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee00b5100 con 0x7feee015c230 2024-09-10T11:40:24.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.544+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7feed8019020 con 0x7feee015c230 2024-09-10T11:40:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.545+0000 7feed5ffb640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feec40750a0 0x7feec4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.545+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7feed8096820 con 0x7feee015c230 2024-09-10T11:40:24.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.545+0000 7feee52f9640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feec40750a0 0x7feec4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:24.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.546+0000 7feee52f9640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feec40750a0 0x7feec4077560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feedc0095f0 tx=0x7feedc004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:24.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.552+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7feed8020020 con 0x7feee015c230 2024-09-10T11:40:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.859+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feee015d3f0 con 0x7feee015c230 2024-09-10T11:40:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.859+0000 7feed5ffb640 1 -- 172.21.15.57:0/10887983 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7feed80604b0 con 0x7feee015c230 2024-09-10T11:40:24.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:24.862 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feec40750a0 msgr2=0x7feec4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feec40750a0 0x7feec4077560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feedc0095f0 tx=0x7feedc004730 comp rx=0 tx=0).stop 2024-09-10T11:40:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 msgr2=0x7feee01f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee01f5a10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed800cae0 tx=0x7feed800a060 comp rx=0 tx=0).stop 2024-09-10T11:40:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 shutdown_connections 2024-09-10T11:40:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feec40750a0 0x7feec4077560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee015c230 0x7feee01f5a10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feee0074540 0x7feee009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 --2- 172.21.15.57:0/10887983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feee0068610 0x7feee009dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 >> 172.21.15.57:0/10887983 conn(0x7feee00b55c0 msgr2=0x7feee015e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 shutdown_connections 2024-09-10T11:40:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:24.862+0000 7feee755d640 1 -- 172.21.15.57:0/10887983 wait complete. 2024-09-10T11:40:27.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:28.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 -- 172.21.15.57:0/1001937816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 msgr2=0x7fb1a40b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/1001937816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a40b3eb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40b6360 tx=0x7fb19802a560 comp rx=0 tx=0).stop 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 -- 172.21.15.57:0/1001937816 shutdown_connections 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/1001937816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a40b3eb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/1001937816 >> v2:172.21.15.154:3300/0 conn(0x7fb1a415abd0 0x7fb1a40740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 -- 172.21.15.57:0/1001937816 >> 172.21.15.57:0/1001937816 conn(0x7fb1a40d01e0 msgr2=0x7fb1a40d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 -- 172.21.15.57:0/1001937816 shutdown_connections 2024-09-10T11:40:28.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.003+0000 7fb1a9a48640 1 -- 172.21.15.57:0/1001937816 wait complete. 2024-09-10T11:40:28.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.005+0000 7fb1a9a48640 1 Processor -- start 2024-09-10T11:40:28.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.005+0000 7fb1a9a48640 1 -- start start 2024-09-10T11:40:28.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.006+0000 7fb1a9a48640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.006+0000 7fb1a9a48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a40b3960 0x7fb1a40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.006+0000 7fb1a9a48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a415abd0 0x7fb1a41f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.006+0000 7fb1a9a48640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a40b4570 con 0x7fb1a4070fc0 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.006+0000 7fb1a9a48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a40b43f0 con 0x7fb1a40b3960 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.006+0000 7fb1a9a48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a40b46f0 con 0x7fb1a415abd0 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a41530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36240/0 (socket says 172.21.15.57:36240) 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 -- 172.21.15.57:0/2123497679 learned_addr learned my addr 172.21.15.57:0/2123497679 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a27fc640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a40b3960 0x7fb1a40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a37fe640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a415abd0 0x7fb1a41f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 -- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a415abd0 msgr2=0x7fb1a41f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a415abd0 0x7fb1a41f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 -- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a40b3960 msgr2=0x7fb1a40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a40b3960 0x7fb1a40c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 -- 172.21.15.57:0/2123497679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a40c59f0 con 0x7fb1a4070fc0 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a27fc640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a40b3960 0x7fb1a40c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a2ffd640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a41530e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb19400eb70 tx=0x7fb19400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19400be60 con 0x7fb1a4070fc0 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb194004020 con 0x7fb1a4070fc0 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004450 con 0x7fb1a4070fc0 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.007+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a41537f0 con 0x7fb1a4070fc0 2024-09-10T11:40:28.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.008+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a4153db0 con 0x7fb1a4070fc0 2024-09-10T11:40:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.009+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a40b3eb0 con 0x7fb1a4070fc0 2024-09-10T11:40:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.010+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb1940035f0 con 0x7fb1a4070fc0 2024-09-10T11:40:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.010+0000 7fb18bfff640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb1900750f0 0x7fb1900775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.010+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb194098540 con 0x7fb1a4070fc0 2024-09-10T11:40:28.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.010+0000 7fb1a27fc640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb1900750f0 0x7fb1900775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:28.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.011+0000 7fb1a27fc640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb1900750f0 0x7fb1900775b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb198033000 tx=0x7fb198004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:28.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.016+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb1940621b0 con 0x7fb1a4070fc0 2024-09-10T11:40:28.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.352+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb1a4074970 con 0x7fb1a4070fc0 2024-09-10T11:40:28.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.352+0000 7fb18bfff640 1 -- 172.21.15.57:0/2123497679 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb194066970 con 0x7fb1a4070fc0 2024-09-10T11:40:28.354 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:28.354 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.354+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb1900750f0 msgr2=0x7fb1900775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.354+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb1900750f0 0x7fb1900775b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb198033000 tx=0x7fb198004730 comp rx=0 tx=0).stop 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.354+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 msgr2=0x7fb1a41530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.354+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a41530e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb19400eb70 tx=0x7fb19400b690 comp rx=0 tx=0).stop 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.354+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 shutdown_connections 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.354+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb1900750f0 0x7fb1900775b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.355+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a415abd0 0x7fb1a41f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.355+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1a40b3960 0x7fb1a40c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.355+0000 7fb1a9a48640 1 --2- 172.21.15.57:0/2123497679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a4070fc0 0x7fb1a41530e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:28.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.355+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 >> 172.21.15.57:0/2123497679 conn(0x7fb1a40d01e0 msgr2=0x7fb1a4151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.355+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 shutdown_connections 2024-09-10T11:40:28.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:28.355+0000 7fb1a9a48640 1 -- 172.21.15.57:0/2123497679 wait complete. 2024-09-10T11:40:30.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:40:30.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:40:31.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:31.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 -- 172.21.15.57:0/1316471013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc04070fb0 msgr2=0x7fdc040cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:31.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 --2- 172.21.15.57:0/1316471013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc04070fb0 0x7fdc040cb2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009830 tx=0x7fdbec02a5c0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 -- 172.21.15.57:0/1316471013 shutdown_connections 2024-09-10T11:40:31.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 --2- 172.21.15.57:0/1316471013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc04070fb0 0x7fdc040cb2c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 -- 172.21.15.57:0/1316471013 >> 172.21.15.57:0/1316471013 conn(0x7fdc040d0a60 msgr2=0x7fdc040d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 -- 172.21.15.57:0/1316471013 shutdown_connections 2024-09-10T11:40:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.515+0000 7fdc09994640 1 -- 172.21.15.57:0/1316471013 wait complete. 2024-09-10T11:40:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.516+0000 7fdc09994640 1 Processor -- start 2024-09-10T11:40:31.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.517+0000 7fdc09994640 1 -- start start 2024-09-10T11:40:31.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.517+0000 7fdc09994640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 0x7fdc040a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:31.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.517+0000 7fdc09994640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc040cb800 0x7fdc0414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.517+0000 7fdc09994640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0415a920 0x7fdc0415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc09994640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdc040cfc90 con 0x7fdc04070fb0 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc09994640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc040cfb10 con 0x7fdc0415a920 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc09994640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc040cfe10 con 0x7fdc040cb800 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 0x7fdc040a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 0x7fdc040a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53324/0 (socket says 172.21.15.57:53324) 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 -- 172.21.15.57:0/1393823247 learned_addr learned my addr 172.21.15.57:0/1393823247 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdbfbfff640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc040cb800 0x7fdc0414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc037fe640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0415a920 0x7fdc0415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 -- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc040cb800 msgr2=0x7fdc0414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc040cb800 0x7fdc0414edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 -- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0415a920 msgr2=0x7fdc0415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:31.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0415a920 0x7fdc0415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 -- 172.21.15.57:0/1393823247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc040a99d0 con 0x7fdc04070fb0 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc02ffd640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 0x7fdc040a9490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400c3a0 tx=0x7fdbf400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40052d0 con 0x7fdc04070fb0 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbf4007020 con 0x7fdc04070fb0 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc041f2a10 con 0x7fdc04070fb0 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40074b0 con 0x7fdc04070fb0 2024-09-10T11:40:31.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.518+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc041f2fd0 con 0x7fdc04070fb0 2024-09-10T11:40:31.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.520+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc040d02c0 con 0x7fdc04070fb0 2024-09-10T11:40:31.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.520+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fdbf40067d0 con 0x7fdc04070fb0 2024-09-10T11:40:31.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.521+0000 7fdc00ff9640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdbe40750a0 0x7fdbe4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:31.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.521+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fdbf40957e0 con 0x7fdc04070fb0 2024-09-10T11:40:31.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.521+0000 7fdbfbfff640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdbe40750a0 0x7fdbe4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:31.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.522+0000 7fdbfbfff640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdbe40750a0 0x7fdbe4077560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbec034000 tx=0x7fdbec004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:31.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.528+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fdbf405f500 con 0x7fdc04070fb0 2024-09-10T11:40:31.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.892+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc040ce010 con 0x7fdc04070fb0 2024-09-10T11:40:31.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.893+0000 7fdc00ff9640 1 -- 172.21.15.57:0/1393823247 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fdbf4063cc0 con 0x7fdc04070fb0 2024-09-10T11:40:31.895 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:31.895 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdbe40750a0 msgr2=0x7fdbe4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdbe40750a0 0x7fdbe4077560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbec034000 tx=0x7fdbec004730 comp rx=0 tx=0).stop 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 msgr2=0x7fdc040a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 0x7fdc040a9490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400c3a0 tx=0x7fdbf400c860 comp rx=0 tx=0).stop 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 shutdown_connections 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdbe40750a0 0x7fdbe4077560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0415a920 0x7fdc0415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc040cb800 0x7fdc0414edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 --2- 172.21.15.57:0/1393823247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc04070fb0 0x7fdc040a9490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 >> 172.21.15.57:0/1393823247 conn(0x7fdc040d0a60 msgr2=0x7fdc040cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 shutdown_connections 2024-09-10T11:40:31.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:31.896+0000 7fdc09994640 1 -- 172.21.15.57:0/1393823247 wait complete. 2024-09-10T11:40:34.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:35.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 -- 172.21.15.57:0/3298064603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 msgr2=0x7f2a280721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/3298064603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 0x7f2a280721b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2a280cd570 tx=0x7f2a1002a560 comp rx=0 tx=0).stop 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 -- 172.21.15.57:0/3298064603 shutdown_connections 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/3298064603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280726f0 0x7f2a2815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/3298064603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 0x7f2a280721b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/3298064603 >> v2:172.21.15.154:3300/0 conn(0x7f2a28144220 0x7f2a2806ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 -- 172.21.15.57:0/3298064603 >> 172.21.15.57:0/3298064603 conn(0x7f2a280b1780 msgr2=0x7f2a280b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 -- 172.21.15.57:0/3298064603 shutdown_connections 2024-09-10T11:40:35.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.053+0000 7f2a2cff5640 1 -- 172.21.15.57:0/3298064603 wait complete. 2024-09-10T11:40:35.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.055+0000 7f2a2cff5640 1 Processor -- start 2024-09-10T11:40:35.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.055+0000 7f2a2cff5640 1 -- start start 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.055+0000 7f2a2cff5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a280726f0 0x7f2a280ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2cff5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 0x7f2a280ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2cff5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 0x7f2a281e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2cff5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2a280cd850 con 0x7f2a28144600 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2cff5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2815b920 con 0x7f2a280726f0 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2cff5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2a280cd9d0 con 0x7f2a28144220 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a280726f0 0x7f2a280ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 0x7f2a280ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a280726f0 0x7f2a280ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58746/0 (socket says 172.21.15.57:58746) 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 0x7f2a280ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:40562/0 (socket says 172.21.15.57:40562) 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a2659c640 1 -- 172.21.15.57:0/2987954727 learned_addr learned my addr 172.21.15.57:0/2987954727 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:35.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a26d9d640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 0x7f2a281e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 -- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a280726f0 msgr2=0x7f2a280ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a280726f0 0x7f2a280ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 -- 172.21.15.57:0/2987954727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 msgr2=0x7f2a281e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 0x7f2a281e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 -- 172.21.15.57:0/2987954727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a28142650 con 0x7f2a28144220 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.056+0000 7f2a1ffff640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 0x7f2a280ad3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a10031000 tx=0x7f2a100038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.057+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1003e030 con 0x7f2a28144220 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.057+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a10003ca0 con 0x7f2a28144220 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.057+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a280adad0 con 0x7f2a28144220 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.057+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10035040 con 0x7f2a28144220 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.057+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2812f470 con 0x7f2a28144220 2024-09-10T11:40:35.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.058+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2806ecf0 con 0x7f2a28144220 2024-09-10T11:40:35.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.059+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2a10041030 con 0x7f2a28144220 2024-09-10T11:40:35.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.060+0000 7f2a1effd640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2a080750d0 0x7f2a08077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:35.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.060+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2a100b6bc0 con 0x7f2a28144220 2024-09-10T11:40:35.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.060+0000 7f2a2659c640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2a080750d0 0x7f2a08077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:35.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.060+0000 7f2a2659c640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2a080750d0 0x7f2a08077590 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009c10 tx=0x7f2a18005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.066+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2a28142650 con 0x7f2a28144220 2024-09-10T11:40:35.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.372+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2a2815b2c0 con 0x7f2a28144220 2024-09-10T11:40:35.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.372+0000 7f2a1effd640 1 -- 172.21.15.57:0/2987954727 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f2a10080730 con 0x7f2a28144220 2024-09-10T11:40:35.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:35.375 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:35.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2a080750d0 msgr2=0x7f2a08077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2a080750d0 0x7f2a08077590 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009c10 tx=0x7f2a18005f90 comp rx=0 tx=0).stop 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 msgr2=0x7f2a280ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 0x7f2a280ad3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a10031000 tx=0x7f2a100038a0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 shutdown_connections 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2a080750d0 0x7f2a08077590 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a28144600 0x7f2a281e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a28144220 0x7f2a280ad3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 --2- 172.21.15.57:0/2987954727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a280726f0 0x7f2a280ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 >> 172.21.15.57:0/2987954727 conn(0x7f2a280b1780 msgr2=0x7f2a280cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 shutdown_connections 2024-09-10T11:40:35.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:35.375+0000 7f2a2cff5640 1 -- 172.21.15.57:0/2987954727 wait complete. 2024-09-10T11:40:38.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:38.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 -- 172.21.15.57:0/193677174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc161110 msgr2=0x7f56dc161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 --2- 172.21.15.57:0/193677174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc161110 0x7f56dc161580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f56dc08ccf0 tx=0x7f56d402a980 comp rx=0 tx=0).stop 2024-09-10T11:40:38.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 -- 172.21.15.57:0/193677174 shutdown_connections 2024-09-10T11:40:38.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 --2- 172.21.15.57:0/193677174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc161110 0x7f56dc161580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 --2- 172.21.15.57:0/193677174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56dc0b4bd0 0x7f56dc0b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 --2- 172.21.15.57:0/193677174 >> v2:172.21.15.154:3300/0 conn(0x7f56dc0b5900 0x7f56dc0d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 -- 172.21.15.57:0/193677174 >> 172.21.15.57:0/193677174 conn(0x7f56dc0d3da0 msgr2=0x7f56dc0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:38.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 -- 172.21.15.57:0/193677174 shutdown_connections 2024-09-10T11:40:38.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.510+0000 7f56e2964640 1 -- 172.21.15.57:0/193677174 wait complete. 2024-09-10T11:40:38.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.512+0000 7f56e2964640 1 Processor -- start 2024-09-10T11:40:38.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.512+0000 7f56e2964640 1 -- start start 2024-09-10T11:40:38.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56e2964640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 0x7f56dc150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:38.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56e2964640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc0b5900 0x7f56dc0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56e2964640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56dc161110 0x7f56dc0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56e2964640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc0d20b0 con 0x7f56dc0b5900 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56e2964640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc0d1f30 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56e2964640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f56dc0d2230 con 0x7f56dc161110 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56db7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc0b5900 0x7f56dc0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56dbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 0x7f56dc150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.513+0000 7f56dbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 0x7f56dc150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58764/0 (socket says 172.21.15.57:58764) 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 -- 172.21.15.57:0/3664655497 learned_addr learned my addr 172.21.15.57:0/3664655497 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:38.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56e0f01640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56dc161110 0x7f56dc0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 -- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56dc161110 msgr2=0x7f56dc0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56dc161110 0x7f56dc0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 -- 172.21.15.57:0/3664655497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc0b5900 msgr2=0x7f56dc0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc0b5900 0x7f56dc0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 -- 172.21.15.57:0/3664655497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc0cc9f0 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56db7fe640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc0b5900 0x7f56dc0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56dbfff640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 0x7f56dc150390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00e9f0 tx=0x7f56cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00cd80 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56cc010430 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56dc0cdd30 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.514+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc010840 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.515+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56dc0ccf70 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.516+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56dc0d4890 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.517+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f56cc0109e0 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.517+0000 7f56d8ff9640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f56c80750a0 0x7f56c8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.518+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f56cc096eb0 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.518+0000 7f56db7fe640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f56c80750a0 0x7f56c8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:38.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.518+0000 7f56db7fe640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f56c80750a0 0x7f56c8077560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56dc1f7f00 tx=0x7f56d0005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:38.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.525+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f56cc060c00 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.786+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f56dc0b41a0 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.787+0000 7f56d8ff9640 1 -- 172.21.15.57:0/3664655497 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f56cc0653c0 con 0x7f56dc0b4bd0 2024-09-10T11:40:38.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:38.789 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f56c80750a0 msgr2=0x7f56c8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f56c80750a0 0x7f56c8077560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56dc1f7f00 tx=0x7f56d0005f90 comp rx=0 tx=0).stop 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 msgr2=0x7f56dc150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 0x7f56dc150390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00e9f0 tx=0x7f56cc00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 shutdown_connections 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f56c80750a0 0x7f56c8077560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56dc161110 0x7f56dc0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56dc0b5900 0x7f56dc0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 --2- 172.21.15.57:0/3664655497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56dc0b4bd0 0x7f56dc150390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 >> 172.21.15.57:0/3664655497 conn(0x7f56dc0d3da0 msgr2=0x7f56dc06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 shutdown_connections 2024-09-10T11:40:38.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:38.790+0000 7f56e2964640 1 -- 172.21.15.57:0/3664655497 wait complete. 2024-09-10T11:40:41.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:41.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 -- 172.21.15.57:0/196967343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb73015b6e0 msgr2=0x7fb73006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 --2- 172.21.15.57:0/196967343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb73015b6e0 0x7fb73006ecf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb728009be0 tx=0x7fb72802a920 comp rx=0 tx=0).stop 2024-09-10T11:40:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 -- 172.21.15.57:0/196967343 shutdown_connections 2024-09-10T11:40:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 --2- 172.21.15.57:0/196967343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb73015b6e0 0x7fb73006ecf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 -- 172.21.15.57:0/196967343 >> 172.21.15.57:0/196967343 conn(0x7fb7300b1780 msgr2=0x7fb7300b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 -- 172.21.15.57:0/196967343 shutdown_connections 2024-09-10T11:40:41.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.935+0000 7fb735ba4640 1 -- 172.21.15.57:0/196967343 wait complete. 2024-09-10T11:40:41.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.937+0000 7fb735ba4640 1 Processor -- start 2024-09-10T11:40:41.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.937+0000 7fb735ba4640 1 -- start start 2024-09-10T11:40:41.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb735ba4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7300728c0 0x7fb73015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb735ba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb730144220 0x7fb7300b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb735ba4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 0x7fb7300b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb735ba4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300cdc60 con 0x7fb73015b6e0 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb735ba4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300cdae0 con 0x7fb730144220 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb735ba4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7300cdde0 con 0x7fb7300728c0 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 0x7fb7300b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 0x7fb7300b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60202/0 (socket says 172.21.15.57:60202) 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb727fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb730144220 0x7fb7300b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 -- 172.21.15.57:0/849587559 learned_addr learned my addr 172.21.15.57:0/849587559 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72f7fe640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7300728c0 0x7fb73015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 -- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7300728c0 msgr2=0x7fb73015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7300728c0 0x7fb73015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 -- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb730144220 msgr2=0x7fb7300b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:41.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb730144220 0x7fb7300b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 -- 172.21.15.57:0/849587559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73015aca0 con 0x7fb73015b6e0 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb727fff640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb730144220 0x7fb7300b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.939+0000 7fb72ffff640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 0x7fb7300b3d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb728009be0 tx=0x7fb728003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.940+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728030c50 con 0x7fb73015b6e0 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.940+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb72803e070 con 0x7fb73015b6e0 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.940+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728032330 con 0x7fb73015b6e0 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.940+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb730138540 con 0x7fb73015b6e0 2024-09-10T11:40:41.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.940+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb730138b00 con 0x7fb73015b6e0 2024-09-10T11:40:41.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.941+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb730073a20 con 0x7fb73015b6e0 2024-09-10T11:40:41.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.942+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb7280324d0 con 0x7fb73015b6e0 2024-09-10T11:40:41.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.942+0000 7fb72cff9640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb7100750a0 0x7fb710077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:41.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.943+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb7280b7860 con 0x7fb73015b6e0 2024-09-10T11:40:41.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.943+0000 7fb72f7fe640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb7100750a0 0x7fb710077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:41.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.943+0000 7fb72f7fe640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb7100750a0 0x7fb710077560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb720007fd0 tx=0x7fb720007f60 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:41.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:41.948+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb730073a20 con 0x7fb73015b6e0 2024-09-10T11:40:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.202+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb7300cce80 con 0x7fb73015b6e0 2024-09-10T11:40:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.202+0000 7fb72cff9640 1 -- 172.21.15.57:0/849587559 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb72802d070 con 0x7fb73015b6e0 2024-09-10T11:40:42.203 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:42.203 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb7100750a0 msgr2=0x7fb710077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb7100750a0 0x7fb710077560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb720007fd0 tx=0x7fb720007f60 comp rx=0 tx=0).stop 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 msgr2=0x7fb7300b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 0x7fb7300b3d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb728009be0 tx=0x7fb728003ba0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 shutdown_connections 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb7100750a0 0x7fb710077560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb73015b6e0 0x7fb7300b3d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.204+0000 7fb735ba4640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb730144220 0x7fb7300b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.205+0000 7fb735ba4640 1 --2- 172.21.15.57:0/849587559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7300728c0 0x7fb73015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.205+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 >> 172.21.15.57:0/849587559 conn(0x7fb7300b1780 msgr2=0x7fb7300b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.205+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 shutdown_connections 2024-09-10T11:40:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:42.205+0000 7fb735ba4640 1 -- 172.21.15.57:0/849587559 wait complete. 2024-09-10T11:40:45.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.332+0000 7fca3cb75640 1 -- 172.21.15.57:0/6800384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca3815e1d0 msgr2=0x7fca380ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.332+0000 7fca3cb75640 1 --2- 172.21.15.57:0/6800384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca3815e1d0 0x7fca380ceae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca28009830 tx=0x7fca2802a510 comp rx=0 tx=0).stop 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.333+0000 7fca3cb75640 1 -- 172.21.15.57:0/6800384 shutdown_connections 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.333+0000 7fca3cb75640 1 --2- 172.21.15.57:0/6800384 >> v2:172.21.15.154:3300/0 conn(0x7fca380cf730 0x7fca381601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.333+0000 7fca3cb75640 1 --2- 172.21.15.57:0/6800384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca3815e1d0 0x7fca380ceae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.333+0000 7fca3cb75640 1 -- 172.21.15.57:0/6800384 >> 172.21.15.57:0/6800384 conn(0x7fca380d3dc0 msgr2=0x7fca380d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.333+0000 7fca3cb75640 1 -- 172.21.15.57:0/6800384 shutdown_connections 2024-09-10T11:40:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.333+0000 7fca3cb75640 1 -- 172.21.15.57:0/6800384 wait complete. 2024-09-10T11:40:45.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.335+0000 7fca3cb75640 1 Processor -- start 2024-09-10T11:40:45.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.335+0000 7fca3cb75640 1 -- start start 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3cb75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 0x7fca381f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3cb75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca380d48e0 0x7fca381f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3cb75640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca381f4a90 0x7fca381f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3cb75640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fca38160c10 con 0x7fca381f4a90 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3cb75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca38160a90 con 0x7fca380d48e0 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3cb75640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca38160d90 con 0x7fca380cf730 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 0x7fca381f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 0x7fca381f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:46432/0 (socket says 172.21.15.57:46432) 2024-09-10T11:40:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 -- 172.21.15.57:0/3790084098 learned_addr learned my addr 172.21.15.57:0/3790084098 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca36d9d640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca381f4a90 0x7fca381f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca35d9b640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca380d48e0 0x7fca381f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 -- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca380d48e0 msgr2=0x7fca381f85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca380d48e0 0x7fca381f85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 -- 172.21.15.57:0/3790084098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca381f4a90 msgr2=0x7fca381f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca381f4a90 0x7fca381f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.336+0000 7fca3659c640 1 -- 172.21.15.57:0/3790084098 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca381f5d80 con 0x7fca380cf730 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.337+0000 7fca3659c640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 0x7fca381f8080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca28000c00 tx=0x7fca28033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.337+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28005c90 con 0x7fca380cf730 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.337+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca28031e50 con 0x7fca380cf730 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.337+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca280332b0 con 0x7fca380cf730 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.337+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca380cc6b0 con 0x7fca380cf730 2024-09-10T11:40:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.337+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381f6020 con 0x7fca380cf730 2024-09-10T11:40:45.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.338+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca38161320 con 0x7fca380cf730 2024-09-10T11:40:45.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.339+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fca28033450 con 0x7fca380cf730 2024-09-10T11:40:45.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.339+0000 7fca26ffd640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fca180750a0 0x7fca18077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:45.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.340+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fca280b74e0 con 0x7fca380cf730 2024-09-10T11:40:45.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.340+0000 7fca35d9b640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fca180750a0 0x7fca18077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:45.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.340+0000 7fca35d9b640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fca180750a0 0x7fca18077560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca2c007fd0 tx=0x7fca2c001410 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:45.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.345+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fca2803f030 con 0x7fca380cf730 2024-09-10T11:40:45.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.613+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fca380b64e0 con 0x7fca380cf730 2024-09-10T11:40:45.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.613+0000 7fca26ffd640 1 -- 172.21.15.57:0/3790084098 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fca28081170 con 0x7fca380cf730 2024-09-10T11:40:45.615 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:45.615 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fca180750a0 msgr2=0x7fca18077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fca180750a0 0x7fca18077560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca2c007fd0 tx=0x7fca2c001410 comp rx=0 tx=0).stop 2024-09-10T11:40:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 msgr2=0x7fca381f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 0x7fca381f8080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca28000c00 tx=0x7fca28033c20 comp rx=0 tx=0).stop 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 shutdown_connections 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fca180750a0 0x7fca18077560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca381f4a90 0x7fca381f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca380d48e0 0x7fca381f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 --2- 172.21.15.57:0/3790084098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca380cf730 0x7fca381f8080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 >> 172.21.15.57:0/3790084098 conn(0x7fca380d3dc0 msgr2=0x7fca380b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 shutdown_connections 2024-09-10T11:40:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:45.616+0000 7fca3cb75640 1 -- 172.21.15.57:0/3790084098 wait complete. 2024-09-10T11:40:48.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 -- 172.21.15.57:0/526744616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec15f290 msgr2=0x7f9bec0cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:48.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/526744616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec15f290 0x7f9bec0cfee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0098e0 tx=0x7f9bdc02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 -- 172.21.15.57:0/526744616 shutdown_connections 2024-09-10T11:40:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/526744616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 0x7f9bec0b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/526744616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec15f290 0x7f9bec0cfee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 -- 172.21.15.57:0/526744616 >> 172.21.15.57:0/526744616 conn(0x7f9bec0d1b00 msgr2=0x7f9bec0d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 -- 172.21.15.57:0/526744616 shutdown_connections 2024-09-10T11:40:48.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.765+0000 7f9bf26b8640 1 -- 172.21.15.57:0/526744616 wait complete. 2024-09-10T11:40:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.767+0000 7f9bf26b8640 1 Processor -- start 2024-09-10T11:40:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.767+0000 7f9bf26b8640 1 -- start start 2024-09-10T11:40:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.768+0000 7f9bf26b8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 0x7f9bec1f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.768+0000 7f9bf26b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bec0d0420 0x7f9bec149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.768+0000 7f9bf26b8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0c8040 0x7f9bec1f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bf26b8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0ce030 con 0x7f9bec0c8040 2024-09-10T11:40:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bf26b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0cdeb0 con 0x7f9bec0d0420 2024-09-10T11:40:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bf26b8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec0b2710 con 0x7f9bec0cd6e0 2024-09-10T11:40:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bf0c55640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0c8040 0x7f9bec1f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 0x7f9bec1f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bec0d0420 0x7f9bec149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 0x7f9bec1f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:46450/0 (socket says 172.21.15.57:46450) 2024-09-10T11:40:48.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bebfff640 1 -- 172.21.15.57:0/1093396552 learned_addr learned my addr 172.21.15.57:0/1093396552 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:48.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 -- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 msgr2=0x7f9bec1f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:48.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 0x7f9bec1f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 -- 172.21.15.57:0/1093396552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0c8040 msgr2=0x7f9bec1f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0c8040 0x7f9bec1f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 -- 172.21.15.57:0/1093396552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec1f5290 con 0x7f9bec0d0420 2024-09-10T11:40:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bf0c55640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0c8040 0x7f9bec1f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9beb7fe640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bec0d0420 0x7f9bec149630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9be000c370 tx=0x7f9be000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0017070 con 0x7f9bec0d0420 2024-09-10T11:40:48.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9be00053c0 con 0x7f9bec0d0420 2024-09-10T11:40:48.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec1f86a0 con 0x7f9bec0d0420 2024-09-10T11:40:48.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.769+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0003850 con 0x7f9bec0d0420 2024-09-10T11:40:48.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.770+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec1f8c60 con 0x7f9bec0d0420 2024-09-10T11:40:48.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.771+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bec0b2ca0 con 0x7f9bec0d0420 2024-09-10T11:40:48.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.771+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f9be001a070 con 0x7f9bec0d0420 2024-09-10T11:40:48.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.772+0000 7f9be8ff9640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9bd80750d0 0x7f9bd8077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.772+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9be00954f0 con 0x7f9bec0d0420 2024-09-10T11:40:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.772+0000 7f9bebfff640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9bd80750d0 0x7f9bd8077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.773+0000 7f9bebfff640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9bd80750d0 0x7f9bd8077590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc02ab40 tx=0x7f9bdc004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:48.778+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f9be005f210 con 0x7f9bec0d0420 2024-09-10T11:40:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.071+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9bec0b3be0 con 0x7f9bec0d0420 2024-09-10T11:40:49.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.071+0000 7f9be8ff9640 1 -- 172.21.15.57:0/1093396552 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f9be00639d0 con 0x7f9bec0d0420 2024-09-10T11:40:49.072 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:49.072 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9bd80750d0 msgr2=0x7f9bd8077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9bd80750d0 0x7f9bd8077590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc02ab40 tx=0x7f9bdc004730 comp rx=0 tx=0).stop 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bec0d0420 msgr2=0x7f9bec149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bec0d0420 0x7f9bec149630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9be000c370 tx=0x7f9be000c830 comp rx=0 tx=0).stop 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 shutdown_connections 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9bd80750d0 0x7f9bd8077590 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0c8040 0x7f9bec1f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bec0d0420 0x7f9bec149630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 --2- 172.21.15.57:0/1093396552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bec0cd6e0 0x7f9bec1f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 >> 172.21.15.57:0/1093396552 conn(0x7f9bec0d1b00 msgr2=0x7f9bec0aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 shutdown_connections 2024-09-10T11:40:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:49.074+0000 7f9bf26b8640 1 -- 172.21.15.57:0/1093396552 wait complete. 2024-09-10T11:40:52.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/3274609286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 msgr2=0x7fc8d40740c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/3274609286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d40740c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009830 tx=0x7fc8c802a480 comp rx=0 tx=0).stop 2024-09-10T11:40:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/3274609286 shutdown_connections 2024-09-10T11:40:52.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/3274609286 >> v2:172.21.15.57:3300/0 conn(0x7fc8d4070fc0 0x7fc8d40cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/3274609286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d40740c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/3274609286 >> 172.21.15.57:0/3274609286 conn(0x7fc8d40d01e0 msgr2=0x7fc8d40d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/3274609286 shutdown_connections 2024-09-10T11:40:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.215+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/3274609286 wait complete. 2024-09-10T11:40:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.216+0000 7fc8d9b2c640 1 Processor -- start 2024-09-10T11:40:52.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.216+0000 7fc8d9b2c640 1 -- start start 2024-09-10T11:40:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.217+0000 7fc8d9b2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 0x7fc8d40cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.217+0000 7fc8d9b2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d41f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.217+0000 7fc8d9b2c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 0x7fc8d4148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.217+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 0x7fc8d4148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.217+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 0x7fc8d40cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 0x7fc8d4148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46550/0 (socket says 172.21.15.57:46550) 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d9b2c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d40b3cf0 con 0x7fc8d415abd0 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d3fff640 1 -- 172.21.15.57:0/2790051912 learned_addr learned my addr 172.21.15.57:0/2790051912 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 0x7fc8d40cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:37610/0 (socket says 172.21.15.57:37610) 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d40b3b70 con 0x7fc8d4070fc0 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d40cda40 con 0x7fc8d40b45c0 2024-09-10T11:40:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d41f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 -- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 msgr2=0x7fc8d40cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 0x7fc8d40cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 -- 172.21.15.57:0/2790051912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 msgr2=0x7fc8d4148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 0x7fc8d4148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d41f8680 con 0x7fc8d40b45c0 2024-09-10T11:40:52.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d3fff640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 0x7fc8d4148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d37fe640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 0x7fc8d40cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8d2ffd640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d41f8140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8031000 tx=0x7fc8c8032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8040070 con 0x7fc8d40b45c0 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8c8005310 con 0x7fc8d40b45c0 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.218+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8005c90 con 0x7fc8d40b45c0 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.219+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d41f8900 con 0x7fc8d40b45c0 2024-09-10T11:40:52.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.219+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41f8ec0 con 0x7fc8d40b45c0 2024-09-10T11:40:52.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.220+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d41f9090 con 0x7fc8d40b45c0 2024-09-10T11:40:52.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.220+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fc8c8039040 con 0x7fc8d40b45c0 2024-09-10T11:40:52.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.221+0000 7fc8bbfff640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc8c00750a0 0x7fc8c0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:52.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.221+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc8c80b7540 con 0x7fc8d40b45c0 2024-09-10T11:40:52.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.221+0000 7fc8d37fe640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc8c00750a0 0x7fc8c0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:52.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.221+0000 7fc8d37fe640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc8c00750a0 0x7fc8c0077560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4074480 tx=0x7fc8c4007f70 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.226+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fc8d41f9090 con 0x7fc8d40b45c0 2024-09-10T11:40:52.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.572+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc8d40cd500 con 0x7fc8d40b45c0 2024-09-10T11:40:52.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.573+0000 7fc8bbfff640 1 -- 172.21.15.57:0/2790051912 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc8d41f8680 con 0x7fc8d40b45c0 2024-09-10T11:40:52.574 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:52.574 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.575+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc8c00750a0 msgr2=0x7fc8c0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.575+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc8c00750a0 0x7fc8c0077560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4074480 tx=0x7fc8c4007f70 comp rx=0 tx=0).stop 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 msgr2=0x7fc8d41f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d41f8140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8031000 tx=0x7fc8c8032c10 comp rx=0 tx=0).stop 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 shutdown_connections 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc8c00750a0 0x7fc8c0077560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d415abd0 0x7fc8d4148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8d40b45c0 0x7fc8d41f8140 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 --2- 172.21.15.57:0/2790051912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8d4070fc0 0x7fc8d40cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 >> 172.21.15.57:0/2790051912 conn(0x7fc8d40d01e0 msgr2=0x7fc8d4070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:52.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 shutdown_connections 2024-09-10T11:40:52.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:52.576+0000 7fc8d9b2c640 1 -- 172.21.15.57:0/2790051912 wait complete. 2024-09-10T11:40:55.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:55.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 -- 172.21.15.57:0/3249774017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b940cc570 msgr2=0x7f3b94073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:55.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 --2- 172.21.15.57:0/3249774017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b940cc570 0x7f3b94073c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009860 tx=0x7f3b8802a510 comp rx=0 tx=0).stop 2024-09-10T11:40:55.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 -- 172.21.15.57:0/3249774017 shutdown_connections 2024-09-10T11:40:55.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 --2- 172.21.15.57:0/3249774017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b940cc570 0x7f3b94073c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:55.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 -- 172.21.15.57:0/3249774017 >> 172.21.15.57:0/3249774017 conn(0x7f3b940cd430 msgr2=0x7f3b940cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:55.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 -- 172.21.15.57:0/3249774017 shutdown_connections 2024-09-10T11:40:55.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.712+0000 7f3b99fec640 1 -- 172.21.15.57:0/3249774017 wait complete. 2024-09-10T11:40:55.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.714+0000 7f3b99fec640 1 Processor -- start 2024-09-10T11:40:55.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.715+0000 7f3b99fec640 1 -- start start 2024-09-10T11:40:55.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b99fec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 0x7f3b9406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:55.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b99fec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b9415a600 0x7f3b9406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:55.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b99fec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b9415e460 0x7f3b940aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:55.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b937fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 0x7f3b9406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b99fec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9415b480 con 0x7f3b940cc570 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b99fec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9415b300 con 0x7f3b9415e460 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b99fec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3b9415b600 con 0x7f3b9415a600 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b937fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 0x7f3b9406c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46562/0 (socket says 172.21.15.57:46562) 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b937fe640 1 -- 172.21.15.57:0/1856872951 learned_addr learned my addr 172.21.15.57:0/1856872951 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b92ffd640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b9415a600 0x7f3b9406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.716+0000 7f3b93fff640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b9415e460 0x7f3b940aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b937fe640 1 -- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b9415a600 msgr2=0x7f3b9406ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b937fe640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b9415a600 0x7f3b9406ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b937fe640 1 -- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b9415e460 msgr2=0x7f3b940aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b937fe640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b9415e460 0x7f3b940aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b937fe640 1 -- 172.21.15.57:0/1856872951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b941f2670 con 0x7f3b940cc570 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b92ffd640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b9415a600 0x7f3b9406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b937fe640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 0x7f3b9406c8d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400c490 tx=0x7f3b8400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b840052d0 con 0x7f3b940cc570 2024-09-10T11:40:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b84005490 con 0x7f3b940cc570 2024-09-10T11:40:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b941f2950 con 0x7f3b940cc570 2024-09-10T11:40:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84012890 con 0x7f3b940cc570 2024-09-10T11:40:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.717+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b941f2f10 con 0x7f3b940cc570 2024-09-10T11:40:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.719+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9415ba50 con 0x7f3b940cc570 2024-09-10T11:40:55.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.719+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f3b84012a30 con 0x7f3b940cc570 2024-09-10T11:40:55.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.720+0000 7f3b7bfff640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3b800750a0 0x7f3b80077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:55.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.720+0000 7f3b92ffd640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3b800750a0 0x7f3b80077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.720+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f3b84095d00 con 0x7f3b940cc570 2024-09-10T11:40:55.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.721+0000 7f3b92ffd640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3b800750a0 0x7f3b80077560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b88034000 tx=0x7f3b88004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:55.726+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f3b8405fa20 con 0x7f3b940cc570 2024-09-10T11:40:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.047+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3b940d0140 con 0x7f3b940cc570 2024-09-10T11:40:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.048+0000 7f3b7bfff640 1 -- 172.21.15.57:0/1856872951 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f3b840641e0 con 0x7f3b940cc570 2024-09-10T11:40:56.049 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:56.049 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3b800750a0 msgr2=0x7f3b80077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3b800750a0 0x7f3b80077560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b88034000 tx=0x7f3b88004730 comp rx=0 tx=0).stop 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 msgr2=0x7f3b9406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 0x7f3b9406c8d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400c490 tx=0x7f3b8400c950 comp rx=0 tx=0).stop 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 shutdown_connections 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3b800750a0 0x7f3b80077560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b9415e460 0x7f3b940aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b9415a600 0x7f3b9406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 --2- 172.21.15.57:0/1856872951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b940cc570 0x7f3b9406c8d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 >> 172.21.15.57:0/1856872951 conn(0x7f3b940cd430 msgr2=0x7f3b9415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 shutdown_connections 2024-09-10T11:40:56.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:56.051+0000 7f3b99fec640 1 -- 172.21.15.57:0/1856872951 wait complete. 2024-09-10T11:40:59.064 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 -- 172.21.15.57:0/2841613164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 msgr2=0x7f2b0c0b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/2841613164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c0b5ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0b5500 tx=0x7f2b0402aa30 comp rx=0 tx=0).stop 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 -- 172.21.15.57:0/2841613164 shutdown_connections 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/2841613164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c0b5ce0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/2841613164 >> v2:172.21.15.154:3300/0 conn(0x7f2b0c161820 0x7f2b0c0d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 -- 172.21.15.57:0/2841613164 >> 172.21.15.57:0/2841613164 conn(0x7f2b0c0d3da0 msgr2=0x7f2b0c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:59.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 -- 172.21.15.57:0/2841613164 shutdown_connections 2024-09-10T11:40:59.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.211+0000 7f2b11fb4640 1 -- 172.21.15.57:0/2841613164 wait complete. 2024-09-10T11:40:59.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.213+0000 7f2b11fb4640 1 Processor -- start 2024-09-10T11:40:59.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.213+0000 7f2b11fb4640 1 -- start start 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.214+0000 7f2b11fb4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.214+0000 7f2b11fb4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 0x7f2b0c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.214+0000 7f2b11fb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 0x7f2b0c0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.214+0000 7f2b11fb4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c0b3cc0 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.214+0000 7f2b11fb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c0b3b40 con 0x7f2b0c161820 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.214+0000 7f2b11fb4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0c0b3e40 con 0x7f2b0c0b5900 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 0x7f2b0c0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 0x7f2b0c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 0x7f2b0c0cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:38988/0 (socket says 172.21.15.57:38988) 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46586/0 (socket says 172.21.15.57:46586) 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0affd640 1 -- 172.21.15.57:0/4255732622 learned_addr learned my addr 172.21.15.57:0/4255732622 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 0x7f2b0c0cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:37638/0 (socket says 172.21.15.57:37638) 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 -- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 msgr2=0x7f2b0c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 0x7f2b0c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 -- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 msgr2=0x7f2b0c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 0x7f2b0c0cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 -- 172.21.15.57:0/4255732622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c15bc90 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0affd640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 0x7f2b0c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0bfff640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 0x7f2b0c0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b0b7fe640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c15b320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00c3c0 tx=0x7f2afc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:59.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc017070 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2afc0053c0 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c15bf00 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.215+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc003850 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.216+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c15c4c0 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.217+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c0b5ce0 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.218+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2afc01a070 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.218+0000 7f2af3fff640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2af80750a0 0x7f2af8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:40:59.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.218+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2afc095650 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.218+0000 7f2b0affd640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2af80750a0 0x7f2af8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:40:59.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.219+0000 7f2b0affd640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2af80750a0 0x7f2af8077560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2b000058c0 tx=0x7f2b00005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:40:59.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.225+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2afc05f370 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.500+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b0c0caba0 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.501+0000 7f2af3fff640 1 -- 172.21.15.57:0/4255732622 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f2afc066e20 con 0x7f2b0c0b4bd0 2024-09-10T11:40:59.502 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:40:59.502 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2af80750a0 msgr2=0x7f2af8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2af80750a0 0x7f2af8077560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2b000058c0 tx=0x7f2b00005f90 comp rx=0 tx=0).stop 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 msgr2=0x7f2b0c15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c15b320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00c3c0 tx=0x7f2afc00c880 comp rx=0 tx=0).stop 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 shutdown_connections 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2af80750a0 0x7f2af8077560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0c161820 0x7f2b0c0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0c0b5900 0x7f2b0c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.503+0000 7f2b11fb4640 1 --2- 172.21.15.57:0/4255732622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b0c0b4bd0 0x7f2b0c15b320 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:40:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.504+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 >> 172.21.15.57:0/4255732622 conn(0x7f2b0c0d3da0 msgr2=0x7f2b0c06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:40:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.504+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 shutdown_connections 2024-09-10T11:40:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:40:59.504+0000 7f2b11fb4640 1 -- 172.21.15.57:0/4255732622 wait complete. 2024-09-10T11:41:00.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:41:00.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:41:02.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 -- 172.21.15.57:0/1862555377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a9415e1d0 msgr2=0x7f5a940ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 --2- 172.21.15.57:0/1862555377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a9415e1d0 0x7f5a940ceae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a84005fd0 tx=0x7f5a8402a5d0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 -- 172.21.15.57:0/1862555377 shutdown_connections 2024-09-10T11:41:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 --2- 172.21.15.57:0/1862555377 >> v2:172.21.15.57:3300/0 conn(0x7f5a940cf730 0x7f5a941601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 --2- 172.21.15.57:0/1862555377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a9415e1d0 0x7f5a940ceae0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 -- 172.21.15.57:0/1862555377 >> 172.21.15.57:0/1862555377 conn(0x7f5a940d3dc0 msgr2=0x7f5a940d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:02.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 -- 172.21.15.57:0/1862555377 shutdown_connections 2024-09-10T11:41:02.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.643+0000 7f5a98d64640 1 -- 172.21.15.57:0/1862555377 wait complete. 2024-09-10T11:41:02.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.645+0000 7f5a98d64640 1 Processor -- start 2024-09-10T11:41:02.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.645+0000 7f5a98d64640 1 -- start start 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a98d64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 0x7f5a940b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a98d64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a940d48e0 0x7f5a941f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a98d64640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a940b7fe0 0x7f5a940b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a98d64640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5a94160c10 con 0x7f5a940cf730 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a98d64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a94160a90 con 0x7f5a940d48e0 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a98d64640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5a94160d90 con 0x7f5a940b7fe0 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 0x7f5a940b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 0x7f5a940b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35304/0 (socket says 172.21.15.57:35304) 2024-09-10T11:41:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 -- 172.21.15.57:0/355842494 learned_addr learned my addr 172.21.15.57:0/355842494 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a92d9d640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a940b7fe0 0x7f5a940b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a91d9b640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a940d48e0 0x7f5a941f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 -- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a940b7fe0 msgr2=0x7f5a940b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a940b7fe0 0x7f5a940b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 -- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a940d48e0 msgr2=0x7f5a941f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a940d48e0 0x7f5a941f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 -- 172.21.15.57:0/355842494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a940b53d0 con 0x7f5a940cf730 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a92d9d640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a940b7fe0 0x7f5a940b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a91d9b640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a940d48e0 0x7f5a941f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.647+0000 7f5a9259c640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 0x7f5a940b4d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a84034040 tx=0x7f5a840035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.648+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8403e030 con 0x7f5a940cf730 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.648+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a84003ae0 con 0x7f5a940cf730 2024-09-10T11:41:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.648+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a941f4860 con 0x7f5a940cf730 2024-09-10T11:41:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.648+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84035040 con 0x7f5a940cf730 2024-09-10T11:41:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.648+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a941f4510 con 0x7f5a940cf730 2024-09-10T11:41:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.649+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a94161320 con 0x7f5a940cf730 2024-09-10T11:41:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.650+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f5a84041030 con 0x7f5a940cf730 2024-09-10T11:41:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.651+0000 7f5a82ffd640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5a740750a0 0x7f5a74077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.651+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5a840b6a60 con 0x7f5a940cf730 2024-09-10T11:41:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.651+0000 7f5a91d9b640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5a740750a0 0x7f5a74077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.651+0000 7f5a91d9b640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5a740750a0 0x7f5a74077560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a88007fd0 tx=0x7f5a88009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.657+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f5a84080780 con 0x7f5a940cf730 2024-09-10T11:41:02.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.997+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a941618a0 con 0x7f5a940cf730 2024-09-10T11:41:02.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.997+0000 7f5a82ffd640 1 -- 172.21.15.57:0/355842494 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f5a84084f40 con 0x7f5a940cf730 2024-09-10T11:41:02.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:02.998 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:03.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5a740750a0 msgr2=0x7f5a74077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:03.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5a740750a0 0x7f5a74077560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5a88007fd0 tx=0x7f5a88009040 comp rx=0 tx=0).stop 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 msgr2=0x7f5a940b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 0x7f5a940b4d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a84034040 tx=0x7f5a840035f0 comp rx=0 tx=0).stop 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 shutdown_connections 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5a740750a0 0x7f5a74077560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a940b7fe0 0x7f5a940b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a940d48e0 0x7f5a941f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 --2- 172.21.15.57:0/355842494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a940cf730 0x7f5a940b4d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 >> 172.21.15.57:0/355842494 conn(0x7f5a940d3dc0 msgr2=0x7f5a940b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 shutdown_connections 2024-09-10T11:41:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:02.999+0000 7f5a98d64640 1 -- 172.21.15.57:0/355842494 wait complete. 2024-09-10T11:41:06.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:06.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 -- 172.21.15.57:0/956160475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240d48e0 msgr2=0x7f65240cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 --2- 172.21.15.57:0/956160475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240d48e0 0x7f65240cf020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f652408d470 tx=0x7f651802a5f0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 -- 172.21.15.57:0/956160475 shutdown_connections 2024-09-10T11:41:06.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 --2- 172.21.15.57:0/956160475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240d48e0 0x7f65240cf020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 --2- 172.21.15.57:0/956160475 >> v2:172.21.15.154:3300/0 conn(0x7f652415e1d0 0x7f65240ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 -- 172.21.15.57:0/956160475 >> 172.21.15.57:0/956160475 conn(0x7f65240d3dc0 msgr2=0x7f65240d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:06.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 -- 172.21.15.57:0/956160475 shutdown_connections 2024-09-10T11:41:06.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.132+0000 7f652a848640 1 -- 172.21.15.57:0/956160475 wait complete. 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.134+0000 7f652a848640 1 Processor -- start 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.134+0000 7f652a848640 1 -- start start 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f652a848640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 0x7f652415c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f652a848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65240d48e0 0x7f652406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f652a848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240b9810 0x7f652406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f652a848640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f652415ee50 con 0x7f65240cf560 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f652a848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f652415ecd0 con 0x7f65240d48e0 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f652a848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f652415efd0 con 0x7f65240b9810 2024-09-10T11:41:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 0x7f652415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 0x7f652415c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35322/0 (socket says 172.21.15.57:35322) 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 -- 172.21.15.57:0/3254973292 learned_addr learned my addr 172.21.15.57:0/3254973292 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f65237fe640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65240d48e0 0x7f652406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6528de5640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240b9810 0x7f652406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 -- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240b9810 msgr2=0x7f652406e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240b9810 0x7f652406e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 -- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65240d48e0 msgr2=0x7f652406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65240d48e0 0x7f652406e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 -- 172.21.15.57:0/3254973292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65241f4b80 con 0x7f65240cf560 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.135+0000 7f6523fff640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 0x7f652415c600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f651400e7c0 tx=0x7f651400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.136+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651400ccc0 con 0x7f65240cf560 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.136+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f651400ce80 con 0x7f65240cf560 2024-09-10T11:41:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.136+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65241f4e60 con 0x7f65240cf560 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.136+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514005280 con 0x7f65240cf560 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.136+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65241f5420 con 0x7f65240cf560 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.137+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652415f480 con 0x7f65240cf560 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.138+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f6514005420 con 0x7f65240cf560 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.138+0000 7f6520ff9640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f65100750a0 0x7f6510077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.139+0000 7f65237fe640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f65100750a0 0x7f6510077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.139+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6514096c30 con 0x7f65240cf560 2024-09-10T11:41:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.139+0000 7f65237fe640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f65100750a0 0x7f6510077560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6518033000 tx=0x7f6518004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:06.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.145+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f65140608c0 con 0x7f65240cf560 2024-09-10T11:41:06.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.496+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65241618a0 con 0x7f65240cf560 2024-09-10T11:41:06.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.497+0000 7f6520ff9640 1 -- 172.21.15.57:0/3254973292 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f6514065080 con 0x7f65240cf560 2024-09-10T11:41:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:06.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.499+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f65100750a0 msgr2=0x7f6510077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.499+0000 7f652a848640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f65100750a0 0x7f6510077560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6518033000 tx=0x7f6518004730 comp rx=0 tx=0).stop 2024-09-10T11:41:06.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.499+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 msgr2=0x7f652415c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:06.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.499+0000 7f652a848640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 0x7f652415c600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f651400e7c0 tx=0x7f651400ec80 comp rx=0 tx=0).stop 2024-09-10T11:41:06.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.499+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 shutdown_connections 2024-09-10T11:41:06.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f65100750a0 0x7f6510077560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240b9810 0x7f652406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65240d48e0 0x7f652406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 --2- 172.21.15.57:0/3254973292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65240cf560 0x7f652415c600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:06.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 >> 172.21.15.57:0/3254973292 conn(0x7f65240d3dc0 msgr2=0x7f65240ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:06.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 shutdown_connections 2024-09-10T11:41:06.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:06.500+0000 7f652a848640 1 -- 172.21.15.57:0/3254973292 wait complete. 2024-09-10T11:41:09.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 -- 172.21.15.57:0/1030221586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 msgr2=0x7f84cc0b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1030221586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc0b5ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009830 tx=0x7f84c002a480 comp rx=0 tx=0).stop 2024-09-10T11:41:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 -- 172.21.15.57:0/1030221586 shutdown_connections 2024-09-10T11:41:09.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1030221586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc0b5ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1030221586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84cc0b5900 0x7f84cc0d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 -- 172.21.15.57:0/1030221586 >> 172.21.15.57:0/1030221586 conn(0x7f84cc0d3da0 msgr2=0x7f84cc0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 -- 172.21.15.57:0/1030221586 shutdown_connections 2024-09-10T11:41:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.646+0000 7f84d1afe640 1 -- 172.21.15.57:0/1030221586 wait complete. 2024-09-10T11:41:09.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.648+0000 7f84d1afe640 1 Processor -- start 2024-09-10T11:41:09.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.649+0000 7f84d1afe640 1 -- start start 2024-09-10T11:41:09.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.650+0000 7f84d1afe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc1f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.650+0000 7f84d1afe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84cc0b5900 0x7f84cc1f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.650+0000 7f84cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc1f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.650+0000 7f84d1afe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84cc161110 0x7f84cc0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.650+0000 7f84cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc1f4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46348/0 (socket says 172.21.15.57:46348) 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84caffd640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84cc0b5900 0x7f84cc1f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 -- 172.21.15.57:0/1811045176 learned_addr learned my addr 172.21.15.57:0/1811045176 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc161720 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cbfff640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84cc161110 0x7f84cc0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc1615a0 con 0x7f84cc0b5900 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc1618a0 con 0x7f84cc161110 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 -- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84cc161110 msgr2=0x7f84cc0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84cc161110 0x7f84cc0c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 -- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84cc0b5900 msgr2=0x7f84cc1f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84cc0b5900 0x7f84cc1f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc1f5680 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84cb7fe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc1f4740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00e9f0 tx=0x7f84bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00cd80 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.651+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84bc005020 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.652+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc0cbf60 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.652+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc005450 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.652+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc1f50c0 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.653+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc0b5ce0 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.653+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f84bc0047a0 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.654+0000 7f84b3fff640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f84b80750a0 0x7f84b8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.654+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f84bc096e10 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.654+0000 7f84caffd640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f84b80750a0 0x7f84b8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:09.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.655+0000 7f84caffd640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f84b80750a0 0x7f84b8077560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84c0034000 tx=0x7f84c0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:09.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.659+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f84bc060b70 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.910+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f84cc0d4600 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.910+0000 7f84b3fff640 1 -- 172.21.15.57:0/1811045176 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f84bc065330 con 0x7f84cc0b4bd0 2024-09-10T11:41:09.911 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:09.911 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f84b80750a0 msgr2=0x7f84b8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f84b80750a0 0x7f84b8077560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f84c0034000 tx=0x7f84c0004730 comp rx=0 tx=0).stop 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 msgr2=0x7f84cc1f4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc1f4740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00e9f0 tx=0x7f84bc00edf0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 shutdown_connections 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f84b80750a0 0x7f84b8077560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84cc161110 0x7f84cc0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84cc0b5900 0x7f84cc1f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 --2- 172.21.15.57:0/1811045176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84cc0b4bd0 0x7f84cc1f4740 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:09.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 >> 172.21.15.57:0/1811045176 conn(0x7f84cc0d3da0 msgr2=0x7f84cc160600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:09.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 shutdown_connections 2024-09-10T11:41:09.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:09.913+0000 7f84d1afe640 1 -- 172.21.15.57:0/1811045176 wait complete. 2024-09-10T11:41:12.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 -- 172.21.15.57:0/1931761529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c015e1d0 msgr2=0x7f15c00ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1931761529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c015e1d0 0x7f15c00ceae0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009830 tx=0x7f15b002a5c0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 -- 172.21.15.57:0/1931761529 shutdown_connections 2024-09-10T11:41:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1931761529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c015e1d0 0x7f15c00ceae0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 -- 172.21.15.57:0/1931761529 >> 172.21.15.57:0/1931761529 conn(0x7f15c00d3dc0 msgr2=0x7f15c00d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:13.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 -- 172.21.15.57:0/1931761529 shutdown_connections 2024-09-10T11:41:13.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.065+0000 7f15c63d5640 1 -- 172.21.15.57:0/1931761529 wait complete. 2024-09-10T11:41:13.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.067+0000 7f15c63d5640 1 Processor -- start 2024-09-10T11:41:13.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.067+0000 7f15c63d5640 1 -- start start 2024-09-10T11:41:13.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c63d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 0x7f15c0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:13.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c63d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c00d48e0 0x7f15c0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:13.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c63d5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c01585e0 0x7f15c01f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c63d5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0160de0 con 0x7f15c01585e0 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c63d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0160c60 con 0x7f15c00cf730 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c63d5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f15c0160f60 con 0x7f15c00d48e0 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15bffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 0x7f15c0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.068+0000 7f15c4972640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c01585e0 0x7f15c01f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15bffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 0x7f15c0159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:36632/0 (socket says 172.21.15.57:36632) 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15bffff640 1 -- 172.21.15.57:0/1553848575 learned_addr learned my addr 172.21.15.57:0/1553848575 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:13.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15bf7fe640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c00d48e0 0x7f15c0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c4972640 1 -- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c00d48e0 msgr2=0x7f15c0153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c4972640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c00d48e0 0x7f15c0153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c4972640 1 -- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 msgr2=0x7f15c0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c4972640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 0x7f15c0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c4972640 1 -- 172.21.15.57:0/1553848575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c0154940 con 0x7f15c01585e0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15bffff640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 0x7f15c0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c4972640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c01585e0 0x7f15c01f8f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15b800c650 tx=0x7f15b800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003b70 con 0x7f15c01585e0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b8003d30 con 0x7f15c01585e0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.069+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c01f9490 con 0x7f15c01585e0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.070+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b80052d0 con 0x7f15c01585e0 2024-09-10T11:41:13.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.070+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c0158d80 con 0x7f15c01585e0 2024-09-10T11:41:13.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.071+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c00b2fb0 con 0x7f15c01585e0 2024-09-10T11:41:13.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.072+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f15b8005470 con 0x7f15c01585e0 2024-09-10T11:41:13.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.072+0000 7f15bcff9640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15ac0750a0 0x7f15ac077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:13.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.073+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f15b8096020 con 0x7f15c01585e0 2024-09-10T11:41:13.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.073+0000 7f15bffff640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15ac0750a0 0x7f15ac077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:13.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.073+0000 7f15bffff640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15ac0750a0 0x7f15ac077560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f15b00095f0 tx=0x7f15b0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:13.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.079+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f15c00b2fb0 con 0x7f15c01585e0 2024-09-10T11:41:13.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.355+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f15c0161410 con 0x7f15c01585e0 2024-09-10T11:41:13.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.355+0000 7f15bcff9640 1 -- 172.21.15.57:0/1553848575 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f15c01f9490 con 0x7f15c01585e0 2024-09-10T11:41:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:13.358 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:13.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15ac0750a0 msgr2=0x7f15ac077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15ac0750a0 0x7f15ac077560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f15b00095f0 tx=0x7f15b0004730 comp rx=0 tx=0).stop 2024-09-10T11:41:13.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c01585e0 msgr2=0x7f15c01f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:13.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c01585e0 0x7f15c01f8f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15b800c650 tx=0x7f15b800cb10 comp rx=0 tx=0).stop 2024-09-10T11:41:13.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 shutdown_connections 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f15ac0750a0 0x7f15ac077560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c01585e0 0x7f15c01f8f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c00d48e0 0x7f15c0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 --2- 172.21.15.57:0/1553848575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c00cf730 0x7f15c0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 >> 172.21.15.57:0/1553848575 conn(0x7f15c00d3dc0 msgr2=0x7f15c00b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 shutdown_connections 2024-09-10T11:41:13.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:13.358+0000 7f15c63d5640 1 -- 172.21.15.57:0/1553848575 wait complete. 2024-09-10T11:41:16.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:16.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 -- 172.21.15.57:0/1076491731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40d48e0 msgr2=0x7f3cc40cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 --2- 172.21.15.57:0/1076491731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40d48e0 0x7f3cc40cf1f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009830 tx=0x7f3cb802a5c0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 -- 172.21.15.57:0/1076491731 shutdown_connections 2024-09-10T11:41:16.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 --2- 172.21.15.57:0/1076491731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40d48e0 0x7f3cc40cf1f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 -- 172.21.15.57:0/1076491731 >> 172.21.15.57:0/1076491731 conn(0x7f3cc40d3dc0 msgr2=0x7f3cc40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:16.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 -- 172.21.15.57:0/1076491731 shutdown_connections 2024-09-10T11:41:16.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.506+0000 7f3cc8896640 1 -- 172.21.15.57:0/1076491731 wait complete. 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.508+0000 7f3cc8896640 1 Processor -- start 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.508+0000 7f3cc8896640 1 -- start start 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc8896640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 0x7f3cc41f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc8896640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc40d48e0 0x7f3cc40c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc8896640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc41f7ed0 0x7f3cc41f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc8896640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4160de0 con 0x7f3cc40cf730 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc8896640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4160c60 con 0x7f3cc41f7ed0 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc8896640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc4160f60 con 0x7f3cc40d48e0 2024-09-10T11:41:16.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 0x7f3cc41f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc1d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc40d48e0 0x7f3cc40c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 0x7f3cc41f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46376/0 (socket says 172.21.15.57:46376) 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc259c640 1 -- 172.21.15.57:0/3621711453 learned_addr learned my addr 172.21.15.57:0/3621711453 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.509+0000 7f3cc2d9d640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc41f7ed0 0x7f3cc41f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc259c640 1 -- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc40d48e0 msgr2=0x7f3cc40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc259c640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc40d48e0 0x7f3cc40c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc259c640 1 -- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc41f7ed0 msgr2=0x7f3cc41f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc259c640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc41f7ed0 0x7f3cc41f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc259c640 1 -- 172.21.15.57:0/3621711453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc4150ad0 con 0x7f3cc40cf730 2024-09-10T11:41:16.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc259c640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 0x7f3cc41f1eb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c3c0 tx=0x7f3cb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4017070 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb40035f0 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc40b7e90 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4003a40 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.510+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc40c9360 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.512+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc4161410 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.512+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f3cb401a070 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.513+0000 7f3cb2ffd640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3ca40750a0 0x7f3ca4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.513+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f3cb4095530 con 0x7f3cc40cf730 2024-09-10T11:41:16.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.513+0000 7f3cc1d9b640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3ca40750a0 0x7f3ca4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:16.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.513+0000 7f3cc1d9b640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3ca40750a0 0x7f3ca4077560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8034000 tx=0x7f3cb8004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:16.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.521+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f3cb405f250 con 0x7f3cc40cf730 2024-09-10T11:41:16.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.787+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3cc40b6790 con 0x7f3cc40cf730 2024-09-10T11:41:16.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.787+0000 7f3cb2ffd640 1 -- 172.21.15.57:0/3621711453 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f3cb4063a10 con 0x7f3cc40cf730 2024-09-10T11:41:16.790 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:16.790 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:16.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3ca40750a0 msgr2=0x7f3ca4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3ca40750a0 0x7f3ca4077560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8034000 tx=0x7f3cb8004730 comp rx=0 tx=0).stop 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 msgr2=0x7f3cc41f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 0x7f3cc41f1eb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c3c0 tx=0x7f3cb400c880 comp rx=0 tx=0).stop 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 shutdown_connections 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f3ca40750a0 0x7f3ca4077560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc41f7ed0 0x7f3cc41f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc40d48e0 0x7f3cc40c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 --2- 172.21.15.57:0/3621711453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cc40cf730 0x7f3cc41f1eb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 >> 172.21.15.57:0/3621711453 conn(0x7f3cc40d3dc0 msgr2=0x7f3cc40cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 shutdown_connections 2024-09-10T11:41:16.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:16.790+0000 7f3cc8896640 1 -- 172.21.15.57:0/3621711453 wait complete. 2024-09-10T11:41:19.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:19.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 -- 172.21.15.57:0/1001826619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef1015e1d0 msgr2=0x7fef100ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 --2- 172.21.15.57:0/1001826619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef1015e1d0 0x7fef100ceae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fef1008d0b0 tx=0x7fef0c02a560 comp rx=0 tx=0).stop 2024-09-10T11:41:19.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 -- 172.21.15.57:0/1001826619 shutdown_connections 2024-09-10T11:41:19.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 --2- 172.21.15.57:0/1001826619 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 0x7fef1015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 --2- 172.21.15.57:0/1001826619 >> v2:172.21.15.154:3300/0 conn(0x7fef100d48e0 0x7fef100cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 --2- 172.21.15.57:0/1001826619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef1015e1d0 0x7fef100ceae0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 -- 172.21.15.57:0/1001826619 >> 172.21.15.57:0/1001826619 conn(0x7fef100d3dc0 msgr2=0x7fef100d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 -- 172.21.15.57:0/1001826619 shutdown_connections 2024-09-10T11:41:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.916+0000 7fef17364640 1 -- 172.21.15.57:0/1001826619 wait complete. 2024-09-10T11:41:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.918+0000 7fef17364640 1 Processor -- start 2024-09-10T11:41:19.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.918+0000 7fef17364640 1 -- start start 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef17364640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 0x7fef100b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef17364640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef100d48e0 0x7fef100b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef17364640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef101f8f10 0x7fef101f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef17364640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fef1015f130 con 0x7fef100d48e0 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef17364640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef1015efb0 con 0x7fef101f8f10 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef17364640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fef1015f2b0 con 0x7fef100cf560 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef15100640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 0x7fef100b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef148ff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef100d48e0 0x7fef100b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef15901640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef101f8f10 0x7fef101f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef15100640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 0x7fef100b9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:47446/0 (socket says 172.21.15.57:47446) 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef15100640 1 -- 172.21.15.57:0/3076502046 learned_addr learned my addr 172.21.15.57:0/3076502046 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef148ff640 1 -- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 msgr2=0x7fef100b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef148ff640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 0x7fef100b9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef148ff640 1 -- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef101f8f10 msgr2=0x7fef101f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef148ff640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef101f8f10 0x7fef101f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.919+0000 7fef148ff640 1 -- 172.21.15.57:0/3076502046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef100b97b0 con 0x7fef100d48e0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.920+0000 7fef148ff640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef100d48e0 0x7fef100b6e60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef0000ea20 tx=0x7fef0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.920+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0000ccc0 con 0x7fef100d48e0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.920+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef100b77a0 con 0x7fef100d48e0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.920+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef00010430 con 0x7fef100d48e0 2024-09-10T11:41:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.920+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00010840 con 0x7fef100d48e0 2024-09-10T11:41:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.920+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef100b7d60 con 0x7fef100d48e0 2024-09-10T11:41:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.922+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef100ce6c0 con 0x7fef100d48e0 2024-09-10T11:41:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.922+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fef000109e0 con 0x7fef100d48e0 2024-09-10T11:41:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.923+0000 7fef05ffb640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feef40750d0 0x7feef4077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.923+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fef00096cf0 con 0x7fef100d48e0 2024-09-10T11:41:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.923+0000 7fef15100640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feef40750d0 0x7feef4077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.923+0000 7fef15100640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feef40750d0 0x7feef4077590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009230 tx=0x7fef0c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:19.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:19.929+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fef100ce6c0 con 0x7fef100d48e0 2024-09-10T11:41:20.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.158+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fef100b3320 con 0x7fef100d48e0 2024-09-10T11:41:20.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.158+0000 7fef05ffb640 1 -- 172.21.15.57:0/3076502046 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fef00060990 con 0x7fef100d48e0 2024-09-10T11:41:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:20.160 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feef40750d0 msgr2=0x7feef4077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feef40750d0 0x7feef4077590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009230 tx=0x7fef0c004730 comp rx=0 tx=0).stop 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef100d48e0 msgr2=0x7fef100b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef100d48e0 0x7fef100b6e60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef0000ea20 tx=0x7fef0000ee20 comp rx=0 tx=0).stop 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 shutdown_connections 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feef40750d0 0x7feef4077590 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef101f8f10 0x7fef101f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:20.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef100d48e0 0x7fef100b6e60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:20.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 --2- 172.21.15.57:0/3076502046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef100cf560 0x7fef100b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:20.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 >> 172.21.15.57:0/3076502046 conn(0x7fef100d3dc0 msgr2=0x7fef100b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:20.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 shutdown_connections 2024-09-10T11:41:20.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:20.160+0000 7fef17364640 1 -- 172.21.15.57:0/3076502046 wait complete. 2024-09-10T11:41:23.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 -- 172.21.15.57:0/1034990719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c161820 msgr2=0x7fd20c0d4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 --2- 172.21.15.57:0/1034990719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c161820 0x7fd20c0d4890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009860 tx=0x7fd1fc02a510 comp rx=0 tx=0).stop 2024-09-10T11:41:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 -- 172.21.15.57:0/1034990719 shutdown_connections 2024-09-10T11:41:23.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 --2- 172.21.15.57:0/1034990719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c161820 0x7fd20c0d4890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 -- 172.21.15.57:0/1034990719 >> 172.21.15.57:0/1034990719 conn(0x7fd20c0d3da0 msgr2=0x7fd20c0d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:23.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 -- 172.21.15.57:0/1034990719 shutdown_connections 2024-09-10T11:41:23.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.298+0000 7fd2132be640 1 -- 172.21.15.57:0/1034990719 wait complete. 2024-09-10T11:41:23.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.300+0000 7fd2132be640 1 Processor -- start 2024-09-10T11:41:23.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.300+0000 7fd2132be640 1 -- start start 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd2132be640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c0b4bd0 0x7fd20c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd2132be640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 0x7fd20c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd2132be640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd20c161820 0x7fd20c0d4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd2132be640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0b40c0 con 0x7fd20c0b5900 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd2132be640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0b3f40 con 0x7fd20c161820 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd2132be640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c0b4240 con 0x7fd20c0b4bd0 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd210859640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 0x7fd20c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd210859640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 0x7fd20c15a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50456/0 (socket says 172.21.15.57:50456) 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd21185b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd20c161820 0x7fd20c0d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd210859640 1 -- 172.21.15.57:0/392754660 learned_addr learned my addr 172.21.15.57:0/392754660 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.301+0000 7fd21105a640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c0b4bd0 0x7fd20c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd21185b640 1 -- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c0b4bd0 msgr2=0x7fd20c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd21185b640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c0b4bd0 0x7fd20c15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd21185b640 1 -- 172.21.15.57:0/392754660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 msgr2=0x7fd20c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd21185b640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 0x7fd20c15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd21185b640 1 -- 172.21.15.57:0/392754660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c0ca430 con 0x7fd20c161820 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd210859640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 0x7fd20c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd21185b640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd20c161820 0x7fd20c0d4180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd20400c6c0 tx=0x7fd20400cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204003b70 con 0x7fd20c161820 2024-09-10T11:41:23.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd204003d10 con 0x7fd20c161820 2024-09-10T11:41:23.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204005330 con 0x7fd20c161820 2024-09-10T11:41:23.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c15de90 con 0x7fd20c161820 2024-09-10T11:41:23.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.302+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1f8190 con 0x7fd20c161820 2024-09-10T11:41:23.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.304+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c0cabe0 con 0x7fd20c161820 2024-09-10T11:41:23.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.305+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd2040054d0 con 0x7fd20c161820 2024-09-10T11:41:23.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.305+0000 7fd201ffb640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd1f00750a0 0x7fd1f0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:23.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.305+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd204096020 con 0x7fd20c161820 2024-09-10T11:41:23.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.305+0000 7fd21105a640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd1f00750a0 0x7fd1f0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:23.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.306+0000 7fd21105a640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd1f00750a0 0x7fd1f0077560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd208007ec0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:23.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.311+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd20c0cabe0 con 0x7fd20c161820 2024-09-10T11:41:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.580+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd20c0b47d0 con 0x7fd20c161820 2024-09-10T11:41:23.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.580+0000 7fd201ffb640 1 -- 172.21.15.57:0/392754660 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd20405fcb0 con 0x7fd20c161820 2024-09-10T11:41:23.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:23.583 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:23.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd1f00750a0 msgr2=0x7fd1f0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd1f00750a0 0x7fd1f0077560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd208007ec0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd20c161820 msgr2=0x7fd20c0d4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd20c161820 0x7fd20c0d4180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd20400c6c0 tx=0x7fd20400cb80 comp rx=0 tx=0).stop 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 shutdown_connections 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd1f00750a0 0x7fd1f0077560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd20c161820 0x7fd20c0d4180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd20c0b5900 0x7fd20c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 --2- 172.21.15.57:0/392754660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd20c0b4bd0 0x7fd20c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 >> 172.21.15.57:0/392754660 conn(0x7fd20c0d3da0 msgr2=0x7fd20c15ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 shutdown_connections 2024-09-10T11:41:23.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:23.583+0000 7fd2132be640 1 -- 172.21.15.57:0/392754660 wait complete. 2024-09-10T11:41:26.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 -- 172.21.15.57:0/653429401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd415eea0 msgr2=0x7fddd406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 --2- 172.21.15.57:0/653429401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd415eea0 0x7fddd406f960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009be0 tx=0x7fddcc02a920 comp rx=0 tx=0).stop 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 -- 172.21.15.57:0/653429401 shutdown_connections 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 --2- 172.21.15.57:0/653429401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd415eea0 0x7fddd406f960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 -- 172.21.15.57:0/653429401 >> 172.21.15.57:0/653429401 conn(0x7fddd40b2620 msgr2=0x7fddd40b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 -- 172.21.15.57:0/653429401 shutdown_connections 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.743+0000 7fddd9249640 1 -- 172.21.15.57:0/653429401 wait complete. 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.744+0000 7fddd9249640 1 Processor -- start 2024-09-10T11:41:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 -- start start 2024-09-10T11:41:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 0x7fddd40cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd40b4310 0x7fddd4158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd415eea0 0x7fddd41f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40710f0 con 0x7fddd40b4310 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4070f70 con 0x7fddd415eea0 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd9249640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fddd406fea0 con 0x7fddd40b3920 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.745+0000 7fddd2d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 0x7fddd40cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 0x7fddd40cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:47484/0 (socket says 172.21.15.57:47484) 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 -- 172.21.15.57:0/684418602 learned_addr learned my addr 172.21.15.57:0/684418602 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd359e640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd415eea0 0x7fddd41f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddcbfff640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd40b4310 0x7fddd4158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 -- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd415eea0 msgr2=0x7fddd41f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd415eea0 0x7fddd41f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 -- 172.21.15.57:0/684418602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd40b4310 msgr2=0x7fddd4158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd40b4310 0x7fddd4158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 -- 172.21.15.57:0/684418602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd41538d0 con 0x7fddd40b3920 2024-09-10T11:41:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddd2d9d640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 0x7fddd40cc520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c490 tx=0x7fddc400c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40052d0 con 0x7fddd40b3920 2024-09-10T11:41:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.746+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddc4005490 con 0x7fddd40b3920 2024-09-10T11:41:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.747+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4012890 con 0x7fddd40b3920 2024-09-10T11:41:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.747+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd4153bb0 con 0x7fddd40b3920 2024-09-10T11:41:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.747+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd4154690 con 0x7fddd40b3920 2024-09-10T11:41:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.748+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4153fa0 con 0x7fddd40b3920 2024-09-10T11:41:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.748+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fddc4012a30 con 0x7fddd40b3920 2024-09-10T11:41:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.749+0000 7fddcb7fe640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fddb40750a0 0x7fddb4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.749+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fddc4095e10 con 0x7fddd40b3920 2024-09-10T11:41:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.749+0000 7fddcbfff640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fddb40750a0 0x7fddb4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.749+0000 7fddcbfff640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fddb40750a0 0x7fddb4077560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddbc007fd0 tx=0x7fddbc007eb0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:26.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:26.755+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fddc405fa00 con 0x7fddd40b3920 2024-09-10T11:41:27.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.004+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fddd4153d80 con 0x7fddd40b3920 2024-09-10T11:41:27.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.004+0000 7fddcb7fe640 1 -- 172.21.15.57:0/684418602 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fddc40641c0 con 0x7fddd40b3920 2024-09-10T11:41:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:27.006 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fddb40750a0 msgr2=0x7fddb4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fddb40750a0 0x7fddb4077560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fddbc007fd0 tx=0x7fddbc007eb0 comp rx=0 tx=0).stop 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 msgr2=0x7fddd40cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 0x7fddd40cc520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c490 tx=0x7fddc400c950 comp rx=0 tx=0).stop 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 shutdown_connections 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fddb40750a0 0x7fddb4077560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:27.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd415eea0 0x7fddd41f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:27.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd40b4310 0x7fddd4158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:27.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 --2- 172.21.15.57:0/684418602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd40b3920 0x7fddd40cc520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:27.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 >> 172.21.15.57:0/684418602 conn(0x7fddd40b2620 msgr2=0x7fddd415d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:27.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 shutdown_connections 2024-09-10T11:41:27.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:27.007+0000 7fddd9249640 1 -- 172.21.15.57:0/684418602 wait complete. 2024-09-10T11:41:30.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:30.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.147+0000 7f81c6ffd640 1 -- 172.21.15.57:0/347596086 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b80047a0 con 0x7f81c815a600 2024-09-10T11:41:30.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 -- 172.21.15.57:0/347596086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 msgr2=0x7f81c8073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 --2- 172.21.15.57:0/347596086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c8073c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f81c806a270 tx=0x7f81b802a4d0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 -- 172.21.15.57:0/347596086 shutdown_connections 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 --2- 172.21.15.57:0/347596086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c80701f0 0x7f81c815e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 --2- 172.21.15.57:0/347596086 >> v2:172.21.15.154:3300/0 conn(0x7f81c806fe10 0x7f81c815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 --2- 172.21.15.57:0/347596086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c8073c20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 -- 172.21.15.57:0/347596086 >> 172.21.15.57:0/347596086 conn(0x7f81c80cd430 msgr2=0x7f81c80cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 -- 172.21.15.57:0/347596086 shutdown_connections 2024-09-10T11:41:30.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.148+0000 7f81ce67f640 1 -- 172.21.15.57:0/347596086 wait complete. 2024-09-10T11:41:30.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.149+0000 7f81ce67f640 1 Processor -- start 2024-09-10T11:41:30.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.149+0000 7f81ce67f640 1 -- start start 2024-09-10T11:41:30.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ce67f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 0x7f81c814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ce67f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c80701f0 0x7f81c81f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ce67f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ce67f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80cc080 con 0x7f81c815a600 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ce67f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80cbf00 con 0x7f81c806fe10 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ce67f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f81c80cc200 con 0x7f81c80701f0 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 0x7f81c814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81ccc1c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 0x7f81c814c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:44402/0 (socket says 172.21.15.57:44402) 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81c7fff640 1 -- 172.21.15.57:0/4294342943 learned_addr learned my addr 172.21.15.57:0/4294342943 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.150+0000 7f81c77fe640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c80701f0 0x7f81c81f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c7fff640 1 -- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c80701f0 msgr2=0x7f81c81f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c7fff640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c80701f0 0x7f81c81f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c7fff640 1 -- 172.21.15.57:0/4294342943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 msgr2=0x7f81c80b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c7fff640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c80b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c7fff640 1 -- 172.21.15.57:0/4294342943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c81f6230 con 0x7f81c806fe10 2024-09-10T11:41:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81ccc1c640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:30.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c7fff640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 0x7f81c814c790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f81b80099c0 tx=0x7f81b80039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b803e030 con 0x7f81c806fe10 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81b80047a0 con 0x7f81c806fe10 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8035040 con 0x7f81c806fe10 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c81f6510 con 0x7f81c806fe10 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.151+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c80c8110 con 0x7f81c806fe10 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.153+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c80cc6d0 con 0x7f81c806fe10 2024-09-10T11:41:30.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.153+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f81b8041030 con 0x7f81c806fe10 2024-09-10T11:41:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.154+0000 7f81c4ff9640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f81b40750a0 0x7f81b4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.154+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f81b80b68b0 con 0x7f81c806fe10 2024-09-10T11:41:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.154+0000 7f81c77fe640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f81b40750a0 0x7f81b4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:30.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.154+0000 7f81c77fe640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f81b40750a0 0x7f81b4077560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f81c80c4130 tx=0x7f81bc00b390 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:30.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.159+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f81b80805d0 con 0x7f81c806fe10 2024-09-10T11:41:30.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.422+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f81c815ebc0 con 0x7f81c806fe10 2024-09-10T11:41:30.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.422+0000 7f81c4ff9640 1 -- 172.21.15.57:0/4294342943 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f81b8084d90 con 0x7f81c806fe10 2024-09-10T11:41:30.424 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:30.425 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f81b40750a0 msgr2=0x7f81b4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f81b40750a0 0x7f81b4077560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f81c80c4130 tx=0x7f81bc00b390 comp rx=0 tx=0).stop 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 msgr2=0x7f81c814c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 0x7f81c814c790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f81b80099c0 tx=0x7f81b80039e0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 shutdown_connections 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f81b40750a0 0x7f81b4077560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81c815a600 0x7f81c80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c80701f0 0x7f81c81f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 --2- 172.21.15.57:0/4294342943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c806fe10 0x7f81c814c790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.424+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 >> 172.21.15.57:0/4294342943 conn(0x7f81c80cd430 msgr2=0x7f81c81587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.425+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 shutdown_connections 2024-09-10T11:41:30.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:30.425+0000 7f81ce67f640 1 -- 172.21.15.57:0/4294342943 wait complete. 2024-09-10T11:41:31.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:41:31.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:41:31.268 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-09-10T11:41:31.266+0000 7fd41ae56640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46674) UID: 0 2024-09-10T11:41:31.268 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-09-10T11:41:31.266+0000 7fd5b0d78640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46674) UID: 0 2024-09-10T11:41:31.268 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-09-10T11:41:31.266+0000 7fd94654a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46674) UID: 0 2024-09-10T11:41:31.269 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-09-10T11:41:31.266+0000 7f739c38f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46674) UID: 0 2024-09-10T11:41:33.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:33.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 -- 172.21.15.57:0/447427615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15b7f0 msgr2=0x7f7a4c0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 --2- 172.21.15.57:0/447427615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15b7f0 0x7f7a4c0b43a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009830 tx=0x7f7a4002a510 comp rx=0 tx=0).stop 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 -- 172.21.15.57:0/447427615 shutdown_connections 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 --2- 172.21.15.57:0/447427615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15cc00 0x7f7a4c15fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 --2- 172.21.15.57:0/447427615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15b7f0 0x7f7a4c0b43a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 -- 172.21.15.57:0/447427615 >> 172.21.15.57:0/447427615 conn(0x7f7a4c06c8d0 msgr2=0x7f7a4c06cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 -- 172.21.15.57:0/447427615 shutdown_connections 2024-09-10T11:41:33.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.582+0000 7f7a531aa640 1 -- 172.21.15.57:0/447427615 wait complete. 2024-09-10T11:41:33.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.584+0000 7f7a531aa640 1 Processor -- start 2024-09-10T11:41:33.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.584+0000 7f7a531aa640 1 -- start start 2024-09-10T11:41:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a531aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 0x7f7a4c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a531aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a4c15bbd0 0x7f7a4c1e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a531aa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15cc00 0x7f7a4c1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a531aa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0cf930 con 0x7f7a4c15cc00 2024-09-10T11:41:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a531aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0cf7b0 con 0x7f7a4c15bbd0 2024-09-10T11:41:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a531aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4c0cfab0 con 0x7f7a4c15b7f0 2024-09-10T11:41:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a50f46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 0x7f7a4c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a4bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a4c15bbd0 0x7f7a4c1e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15cc00 0x7f7a4c1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a50f46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 0x7f7a4c13fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:53838/0 (socket says 172.21.15.57:53838) 2024-09-10T11:41:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a50f46640 1 -- 172.21.15.57:0/886918635 learned_addr learned my addr 172.21.15.57:0/886918635 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 -- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 msgr2=0x7f7a4c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 0x7f7a4c13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 -- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a4c15bbd0 msgr2=0x7f7a4c1e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a4c15bbd0 0x7f7a4c1e9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 -- 172.21.15.57:0/886918635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c13ff70 con 0x7f7a4c15cc00 2024-09-10T11:41:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a50f46640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 0x7f7a4c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:33.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.585+0000 7f7a51747640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15cc00 0x7f7a4c1f7b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400e9b0 tx=0x7f7a4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.586+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400cd80 con 0x7f7a4c15cc00 2024-09-10T11:41:33.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.586+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a44004c10 con 0x7f7a4c15cc00 2024-09-10T11:41:33.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.586+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c1e9b90 con 0x7f7a4c15cc00 2024-09-10T11:41:33.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.586+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44005020 con 0x7f7a4c15cc00 2024-09-10T11:41:33.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.586+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1f8830 con 0x7f7a4c15cc00 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.588+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c1f8a70 con 0x7f7a4c15cc00 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.588+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f7a440051c0 con 0x7f7a4c15cc00 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.588+0000 7f7a497fa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7a300750a0 0x7f7a30077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.589+0000 7f7a50f46640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7a300750a0 0x7f7a30077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.589+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7a44097150 con 0x7f7a4c15cc00 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.589+0000 7f7a50f46640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7a300750a0 0x7f7a30077560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009830 tx=0x7f7a400046c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:33.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.595+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f7a4c1f8a70 con 0x7f7a4c15cc00 2024-09-10T11:41:33.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.950+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7a4c0691f0 con 0x7f7a4c15cc00 2024-09-10T11:41:33.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.950+0000 7f7a497fa640 1 -- 172.21.15.57:0/886918635 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f7a44060cc0 con 0x7f7a4c15cc00 2024-09-10T11:41:33.952 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:33.952 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7a300750a0 msgr2=0x7f7a30077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7a300750a0 0x7f7a30077560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009830 tx=0x7f7a400046c0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15cc00 msgr2=0x7f7a4c1f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15cc00 0x7f7a4c1f7b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400e9b0 tx=0x7f7a4400ee70 comp rx=0 tx=0).stop 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 shutdown_connections 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f7a300750a0 0x7f7a30077560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4c15cc00 0x7f7a4c1f7b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a4c15bbd0 0x7f7a4c1e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.953+0000 7f7a531aa640 1 --2- 172.21.15.57:0/886918635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a4c15b7f0 0x7f7a4c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.954+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 >> 172.21.15.57:0/886918635 conn(0x7f7a4c06c8d0 msgr2=0x7f7a4c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.954+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 shutdown_connections 2024-09-10T11:41:33.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:33.954+0000 7f7a531aa640 1 -- 172.21.15.57:0/886918635 wait complete. 2024-09-10T11:41:36.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.100+0000 7f79d175d640 1 -- 172.21.15.57:0/3075569198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc068610 msgr2=0x7f79cc0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.100+0000 7f79d175d640 1 --2- 172.21.15.57:0/3075569198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc068610 0x7f79cc0730a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f79c0005fd0 tx=0x7f79c002a5f0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.101+0000 7f79d175d640 1 -- 172.21.15.57:0/3075569198 shutdown_connections 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.101+0000 7f79d175d640 1 --2- 172.21.15.57:0/3075569198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 0x7f79cc0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.101+0000 7f79d175d640 1 --2- 172.21.15.57:0/3075569198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc068610 0x7f79cc0730a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.101+0000 7f79d175d640 1 -- 172.21.15.57:0/3075569198 >> 172.21.15.57:0/3075569198 conn(0x7f79cc0d01a0 msgr2=0x7f79cc0d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.101+0000 7f79d175d640 1 -- 172.21.15.57:0/3075569198 shutdown_connections 2024-09-10T11:41:37.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.101+0000 7f79d175d640 1 -- 172.21.15.57:0/3075569198 wait complete. 2024-09-10T11:41:37.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.103+0000 7f79d175d640 1 Processor -- start 2024-09-10T11:41:37.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.103+0000 7f79d175d640 1 -- start start 2024-09-10T11:41:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79d175d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79cc068610 0x7f79cc1f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79d175d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 0x7f79cc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79d175d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 0x7f79cc0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79d175d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc073ca0 con 0x7f79cc158300 2024-09-10T11:41:37.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79d175d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc073b20 con 0x7f79cc068610 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79d175d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc073e20 con 0x7f79cc0cb910 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 0x7f79cc0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79ca7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 0x7f79cc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79caffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79cc068610 0x7f79cc1f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 0x7f79cc0c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58810/0 (socket says 172.21.15.57:58810) 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79cb7fe640 1 -- 172.21.15.57:0/449759177 learned_addr learned my addr 172.21.15.57:0/449759177 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:37.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.104+0000 7f79ca7fc640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 0x7f79cc156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:53864/0 (socket says 172.21.15.57:53864) 2024-09-10T11:41:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79cb7fe640 1 -- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 msgr2=0x7f79cc156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79cb7fe640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 0x7f79cc156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79cb7fe640 1 -- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79cc068610 msgr2=0x7f79cc1f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79cb7fe640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79cc068610 0x7f79cc1f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79cb7fe640 1 -- 172.21.15.57:0/449759177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc1f6090 con 0x7f79cc158300 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79cb7fe640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 0x7f79cc0c3c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f79c400b990 tx=0x7f79c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4019070 con 0x7f79cc158300 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c400cc30 con 0x7f79cc158300 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400ce60 con 0x7f79cc158300 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.105+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc1f6330 con 0x7f79cc158300 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.106+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc1f68f0 con 0x7f79cc158300 2024-09-10T11:41:37.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.107+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc074340 con 0x7f79cc158300 2024-09-10T11:41:37.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.108+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f79c401c070 con 0x7f79cc158300 2024-09-10T11:41:37.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.108+0000 7f79b37fe640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79b80750a0 0x7f79b8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:37.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.109+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f79c4096100 con 0x7f79cc158300 2024-09-10T11:41:37.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.109+0000 7f79caffd640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79b80750a0 0x7f79b8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:37.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.109+0000 7f79caffd640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79b80750a0 0x7f79b8077560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f79bc001720 tx=0x7f79bc009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:37.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.114+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f79c405fd00 con 0x7f79cc158300 2024-09-10T11:41:37.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.450+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79cc06f670 con 0x7f79cc158300 2024-09-10T11:41:37.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.451+0000 7f79b37fe640 1 -- 172.21.15.57:0/449759177 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f79c40644c0 con 0x7f79cc158300 2024-09-10T11:41:37.453 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:37.453 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:37.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79b80750a0 msgr2=0x7f79b8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79b80750a0 0x7f79b8077560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f79bc001720 tx=0x7f79bc009040 comp rx=0 tx=0).stop 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 msgr2=0x7f79cc0c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 0x7f79cc0c3c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f79c400b990 tx=0x7f79c400be50 comp rx=0 tx=0).stop 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 shutdown_connections 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f79b80750a0 0x7f79b8077560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79cc158300 0x7f79cc0c3c90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79cc0cb910 0x7f79cc156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 --2- 172.21.15.57:0/449759177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79cc068610 0x7f79cc1f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.453+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 >> 172.21.15.57:0/449759177 conn(0x7f79cc0d01a0 msgr2=0x7f79cc0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.454+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 shutdown_connections 2024-09-10T11:41:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:37.454+0000 7f79d175d640 1 -- 172.21.15.57:0/449759177 wait complete. 2024-09-10T11:41:40.467 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:40.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 -- 172.21.15.57:0/2601697626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100d48e0 msgr2=0x7fa6100cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 --2- 172.21.15.57:0/2601697626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100d48e0 0x7fa6100cf020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc005fd0 tx=0x7fa5fc02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 -- 172.21.15.57:0/2601697626 shutdown_connections 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 --2- 172.21.15.57:0/2601697626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100d48e0 0x7fa6100cf020 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 --2- 172.21.15.57:0/2601697626 >> v2:172.21.15.154:3300/0 conn(0x7fa61015e1d0 0x7fa6100ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 -- 172.21.15.57:0/2601697626 >> 172.21.15.57:0/2601697626 conn(0x7fa6100d3dc0 msgr2=0x7fa6100d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 -- 172.21.15.57:0/2601697626 shutdown_connections 2024-09-10T11:41:40.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.625+0000 7fa61714b640 1 -- 172.21.15.57:0/2601697626 wait complete. 2024-09-10T11:41:40.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.627+0000 7fa61714b640 1 Processor -- start 2024-09-10T11:41:40.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.627+0000 7fa61714b640 1 -- start start 2024-09-10T11:41:40.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa61714b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 0x7fa6100cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:40.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa61714b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6100d48e0 0x7fa6101585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:40.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa61714b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6100cc530 0x7fa6100c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:40.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa61714b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa61015f060 con 0x7fa6100d48e0 2024-09-10T11:41:40.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa61714b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa61015eee0 con 0x7fa6100cc530 2024-09-10T11:41:40.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa61714b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa61015f1e0 con 0x7fa6100cf560 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa614ee7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 0x7fa6100cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa614ee7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 0x7fa6100cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:44126/0 (socket says 172.21.15.57:44126) 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa614ee7640 1 -- 172.21.15.57:0/3513550645 learned_addr learned my addr 172.21.15.57:0/3513550645 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa60ffff640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6100d48e0 0x7fa6101585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.628+0000 7fa6156e8640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6100cc530 0x7fa6100c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa6156e8640 1 -- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 msgr2=0x7fa6100cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa6156e8640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 0x7fa6100cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa6156e8640 1 -- 172.21.15.57:0/3513550645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6100d48e0 msgr2=0x7fa6101585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa6156e8640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6100d48e0 0x7fa6101585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa6156e8640 1 -- 172.21.15.57:0/3513550645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6100cb490 con 0x7fa6100cc530 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa614ee7640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 0x7fa6100cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:40.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa6156e8640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6100cc530 0x7fa6100c9af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa60800c680 tx=0x7fa60800cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:40.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608003b70 con 0x7fa6100cc530 2024-09-10T11:41:40.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa608003d10 con 0x7fa6100cc530 2024-09-10T11:41:40.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608005330 con 0x7fa6100cc530 2024-09-10T11:41:40.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6100cb770 con 0x7fa6100cc530 2024-09-10T11:41:40.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.629+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6100cbd30 con 0x7fa6100cc530 2024-09-10T11:41:40.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.631+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6101618a0 con 0x7fa6100cc530 2024-09-10T11:41:40.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.631+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa6080054d0 con 0x7fa6100cc530 2024-09-10T11:41:40.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.632+0000 7fa60d7fa640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa5f40750a0 0x7fa5f4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:40.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.632+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa608096070 con 0x7fa6100cc530 2024-09-10T11:41:40.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.632+0000 7fa614ee7640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa5f40750a0 0x7fa5f4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:40.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.633+0000 7fa614ee7640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa5f40750a0 0x7fa5f4077560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa604011440 tx=0x7fa604005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:40.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:40.636+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fa60805fd00 con 0x7fa6100cc530 2024-09-10T11:41:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.003+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6100b3320 con 0x7fa6100cc530 2024-09-10T11:41:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.003+0000 7fa60d7fa640 1 -- 172.21.15.57:0/3513550645 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa6080644c0 con 0x7fa6100cc530 2024-09-10T11:41:41.005 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:41.005 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:41.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.006+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa5f40750a0 msgr2=0x7fa5f4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.006+0000 7fa61714b640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa5f40750a0 0x7fa5f4077560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa604011440 tx=0x7fa604005f90 comp rx=0 tx=0).stop 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.006+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6100cc530 msgr2=0x7fa6100c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.006+0000 7fa61714b640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6100cc530 0x7fa6100c9af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa60800c680 tx=0x7fa60800cb40 comp rx=0 tx=0).stop 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 shutdown_connections 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa5f40750a0 0x7fa5f4077560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6100cc530 0x7fa6100c9af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6100d48e0 0x7fa6101585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 --2- 172.21.15.57:0/3513550645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6100cf560 0x7fa6100cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 >> 172.21.15.57:0/3513550645 conn(0x7fa6100d3dc0 msgr2=0x7fa610160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 shutdown_connections 2024-09-10T11:41:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:41.007+0000 7fa61714b640 1 -- 172.21.15.57:0/3513550645 wait complete. 2024-09-10T11:41:44.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.163+0000 7f6c403a4640 1 -- 172.21.15.57:0/234606468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c3815e1d0 msgr2=0x7f6c380ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.163+0000 7f6c403a4640 1 --2- 172.21.15.57:0/234606468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c3815e1d0 0x7f6c380ceae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009830 tx=0x7f6c3402a510 comp rx=0 tx=0).stop 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.164+0000 7f6c403a4640 1 -- 172.21.15.57:0/234606468 shutdown_connections 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.164+0000 7f6c403a4640 1 --2- 172.21.15.57:0/234606468 >> v2:172.21.15.154:3300/0 conn(0x7f6c380cf730 0x7f6c381601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.164+0000 7f6c403a4640 1 --2- 172.21.15.57:0/234606468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c3815e1d0 0x7f6c380ceae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.164+0000 7f6c403a4640 1 -- 172.21.15.57:0/234606468 >> 172.21.15.57:0/234606468 conn(0x7f6c380d3dc0 msgr2=0x7f6c380d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.164+0000 7f6c403a4640 1 -- 172.21.15.57:0/234606468 shutdown_connections 2024-09-10T11:41:44.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.164+0000 7f6c403a4640 1 -- 172.21.15.57:0/234606468 wait complete. 2024-09-10T11:41:44.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.165+0000 7f6c403a4640 1 Processor -- start 2024-09-10T11:41:44.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.165+0000 7f6c403a4640 1 -- start start 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c403a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c380cf730 0x7f6c381f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c403a4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c380d48e0 0x7f6c380b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c403a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c380cb810 0x7f6c380cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c403a4640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38160c10 con 0x7f6c380cb810 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c403a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38160a90 con 0x7f6c380cf730 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c403a4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c38160d90 con 0x7f6c380d48e0 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c3e140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c380cf730 0x7f6c381f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c3d93f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c380d48e0 0x7f6c380b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c3e140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c380cf730 0x7f6c381f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:42832/0 (socket says 172.21.15.57:42832) 2024-09-10T11:41:44.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c3e140640 1 -- 172.21.15.57:0/4100431896 learned_addr learned my addr 172.21.15.57:0/4100431896 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:44.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.166+0000 7f6c3e941640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c380cb810 0x7f6c380cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c3d93f640 1 -- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c380cf730 msgr2=0x7f6c381f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c3d93f640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c380cf730 0x7f6c381f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c3d93f640 1 -- 172.21.15.57:0/4100431896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c380cb810 msgr2=0x7f6c380cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c3d93f640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c380cb810 0x7f6c380cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c3d93f640 1 -- 172.21.15.57:0/4100431896 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380cbcf0 con 0x7f6c380d48e0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c3d93f640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c380d48e0 0x7f6c380b5b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c3c0 tx=0x7f6c2800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28011790 con 0x7f6c380d48e0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c28017070 con 0x7f6c380d48e0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c380cbfd0 con 0x7f6c380d48e0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.167+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28011d20 con 0x7f6c380d48e0 2024-09-10T11:41:44.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.168+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381f2480 con 0x7f6c380d48e0 2024-09-10T11:41:44.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.169+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c380cc4f0 con 0x7f6c380d48e0 2024-09-10T11:41:44.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.170+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f6c2801c460 con 0x7f6c380d48e0 2024-09-10T11:41:44.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.170+0000 7f6c2effd640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c1c0750d0 0x7f6c1c077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:44.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.170+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6c28095fa0 con 0x7f6c380d48e0 2024-09-10T11:41:44.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.171+0000 7f6c3e140640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c1c0750d0 0x7f6c1c077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:44.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.171+0000 7f6c3e140640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c1c0750d0 0x7f6c1c077590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6c340095f0 tx=0x7f6c34004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:44.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.177+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f6c380cc4f0 con 0x7f6c380d48e0 2024-09-10T11:41:44.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.504+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c38161320 con 0x7f6c380d48e0 2024-09-10T11:41:44.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.504+0000 7f6c2effd640 1 -- 172.21.15.57:0/4100431896 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f6c2805fc20 con 0x7f6c380d48e0 2024-09-10T11:41:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:44.506 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:44.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c1c0750d0 msgr2=0x7f6c1c077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c1c0750d0 0x7f6c1c077590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6c340095f0 tx=0x7f6c34004730 comp rx=0 tx=0).stop 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c380d48e0 msgr2=0x7f6c380b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c380d48e0 0x7f6c380b5b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c3c0 tx=0x7f6c2800c880 comp rx=0 tx=0).stop 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 shutdown_connections 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c1c0750d0 0x7f6c1c077590 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c380cb810 0x7f6c380cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c380d48e0 0x7f6c380b5b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 --2- 172.21.15.57:0/4100431896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c380cf730 0x7f6c381f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 >> 172.21.15.57:0/4100431896 conn(0x7f6c380d3dc0 msgr2=0x7f6c380b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 shutdown_connections 2024-09-10T11:41:44.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:44.507+0000 7f6c403a4640 1 -- 172.21.15.57:0/4100431896 wait complete. 2024-09-10T11:41:47.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:47.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 -- 172.21.15.57:0/3421898371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc200730a0 msgr2=0x7fbc200734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 --2- 172.21.15.57:0/3421898371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc200730a0 0x7fbc200734c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc14005fd0 tx=0x7fbc1402a5c0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 -- 172.21.15.57:0/3421898371 shutdown_connections 2024-09-10T11:41:47.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 --2- 172.21.15.57:0/3421898371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc200730a0 0x7fbc200734c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 --2- 172.21.15.57:0/3421898371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2015f0e0 0x7fbc2006d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 -- 172.21.15.57:0/3421898371 >> 172.21.15.57:0/3421898371 conn(0x7fbc200d0a60 msgr2=0x7fbc200d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:47.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 -- 172.21.15.57:0/3421898371 shutdown_connections 2024-09-10T11:41:47.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.666+0000 7fbc25345640 1 -- 172.21.15.57:0/3421898371 wait complete. 2024-09-10T11:41:47.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.668+0000 7fbc25345640 1 Processor -- start 2024-09-10T11:41:47.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.668+0000 7fbc25345640 1 -- start start 2024-09-10T11:41:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.669+0000 7fbc25345640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 0x7fbc2015b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc25345640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc2015f0e0 0x7fbc200c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc25345640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2014ef50 0x7fbc201e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 0x7fbc2015b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 0x7fbc2015b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:42846/0 (socket says 172.21.15.57:42846) 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1effd640 1 -- 172.21.15.57:0/1774800326 learned_addr learned my addr 172.21.15.57:0/1774800326 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1e7fc640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc2015f0e0 0x7fbc200c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2006e7b0 con 0x7fbc2015f0e0 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2006e630 con 0x7fbc2006df90 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1f7fe640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2014ef50 0x7fbc201e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2014f400 con 0x7fbc2014ef50 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1e7fc640 1 -- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2014ef50 msgr2=0x7fbc201e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1e7fc640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2014ef50 0x7fbc201e86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1e7fc640 1 -- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 msgr2=0x7fbc2015b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.670+0000 7fbc1e7fc640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 0x7fbc2015b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc1e7fc640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2015b890 con 0x7fbc2015f0e0 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc1effd640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 0x7fbc2015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc1e7fc640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc2015f0e0 0x7fbc200c9590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc14031000 tx=0x7fbc140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1403f070 con 0x7fbc2015f0e0 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc201f7f40 con 0x7fbc2015f0e0 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc140047a0 con 0x7fbc2015f0e0 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14035030 con 0x7fbc2015f0e0 2024-09-10T11:41:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.671+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc201f8500 con 0x7fbc2015f0e0 2024-09-10T11:41:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.672+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc200b4330 con 0x7fbc2015f0e0 2024-09-10T11:41:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.673+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fbc14042070 con 0x7fbc2015f0e0 2024-09-10T11:41:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.674+0000 7fbc077fe640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbc0c0750a0 0x7fbc0c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.674+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fbc140b75b0 con 0x7fbc2015f0e0 2024-09-10T11:41:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.674+0000 7fbc1effd640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbc0c0750a0 0x7fbc0c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:47.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.675+0000 7fbc1effd640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbc0c0750a0 0x7fbc0c077560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc2014f5d0 tx=0x7fbc10005f30 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:47.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.680+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fbc14081320 con 0x7fbc2015f0e0 2024-09-10T11:41:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.965+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbc20073480 con 0x7fbc2015f0e0 2024-09-10T11:41:47.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.966+0000 7fbc077fe640 1 -- 172.21.15.57:0/1774800326 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fbc14085ae0 con 0x7fbc2015f0e0 2024-09-10T11:41:47.967 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:47.967 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.967+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbc0c0750a0 msgr2=0x7fbc0c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.967+0000 7fbc25345640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbc0c0750a0 0x7fbc0c077560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc2014f5d0 tx=0x7fbc10005f30 comp rx=0 tx=0).stop 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc2015f0e0 msgr2=0x7fbc200c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc2015f0e0 0x7fbc200c9590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc14031000 tx=0x7fbc140038a0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 shutdown_connections 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbc0c0750a0 0x7fbc0c077560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2014ef50 0x7fbc201e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc2015f0e0 0x7fbc200c9590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 --2- 172.21.15.57:0/1774800326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2006df90 0x7fbc2015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 >> 172.21.15.57:0/1774800326 conn(0x7fbc200d0a60 msgr2=0x7fbc200b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 shutdown_connections 2024-09-10T11:41:47.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:47.968+0000 7fbc25345640 1 -- 172.21.15.57:0/1774800326 wait complete. 2024-09-10T11:41:50.983 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:51.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 -- 172.21.15.57:0/1028964128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840706a0 msgr2=0x7fd0840d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:51.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/1028964128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840706a0 0x7fd0840d01b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd074009830 tx=0x7fd07402a3f0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 -- 172.21.15.57:0/1028964128 shutdown_connections 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/1028964128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 0x7fd084071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/1028964128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840706a0 0x7fd0840d01b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 -- 172.21.15.57:0/1028964128 >> 172.21.15.57:0/1028964128 conn(0x7fd0840d1bf0 msgr2=0x7fd0840d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 -- 172.21.15.57:0/1028964128 shutdown_connections 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.114+0000 7fd08a7c3640 1 -- 172.21.15.57:0/1028964128 wait complete. 2024-09-10T11:41:51.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.116+0000 7fd08a7c3640 1 Processor -- start 2024-09-10T11:41:51.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.116+0000 7fd08a7c3640 1 -- start start 2024-09-10T11:41:51.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd08a7c3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0840706a0 0x7fd0841f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd08a7c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840721a0 0x7fd084159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd08a7c3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 0x7fd084156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd08a7c3640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd08415fad0 con 0x7fd0840706a0 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd08a7c3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd084071f80 con 0x7fd0840721a0 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd08a7c3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd08415fc50 con 0x7fd0840d06f0 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd0837fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840721a0 0x7fd084159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd0837fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840721a0 0x7fd084159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:50610/0 (socket says 172.21.15.57:50610) 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd0837fe640 1 -- 172.21.15.57:0/4146660955 learned_addr learned my addr 172.21.15.57:0/4146660955 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd088d60640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 0x7fd084156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.118+0000 7fd083fff640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0840706a0 0x7fd0841f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd088d60640 1 -- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840721a0 msgr2=0x7fd084159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:51.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd088d60640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840721a0 0x7fd084159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd088d60640 1 -- 172.21.15.57:0/4146660955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0840706a0 msgr2=0x7fd0841f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd088d60640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0840706a0 0x7fd0841f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd088d60640 1 -- 172.21.15.57:0/4146660955 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08415b760 con 0x7fd0840d06f0 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd088d60640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 0x7fd084156a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00eb50 tx=0x7fd07c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c003b70 con 0x7fd0840d06f0 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd07c003d10 con 0x7fd0840d06f0 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08415a0c0 con 0x7fd0840d06f0 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.119+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08415a960 con 0x7fd0840d06f0 2024-09-10T11:41:51.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.120+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c004280 con 0x7fd0840d06f0 2024-09-10T11:41:51.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.121+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd064005290 con 0x7fd0840d06f0 2024-09-10T11:41:51.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.122+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd07c004420 con 0x7fd0840d06f0 2024-09-10T11:41:51.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.122+0000 7fd080ff9640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd0700750a0 0x7fd070077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:51.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.122+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd07c096d20 con 0x7fd0840d06f0 2024-09-10T11:41:51.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.122+0000 7fd083fff640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd0700750a0 0x7fd070077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:51.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.123+0000 7fd083fff640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd0700750a0 0x7fd070077560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd074034000 tx=0x7fd074004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:51.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.126+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd07c065170 con 0x7fd0840d06f0 2024-09-10T11:41:51.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.441+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd064005580 con 0x7fd0840d06f0 2024-09-10T11:41:51.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.442+0000 7fd080ff9640 1 -- 172.21.15.57:0/4146660955 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd07c069b90 con 0x7fd0840d06f0 2024-09-10T11:41:51.443 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:51.443 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:51.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.443+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd0700750a0 msgr2=0x7fd070077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:51.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.443+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd0700750a0 0x7fd070077560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd074034000 tx=0x7fd074004730 comp rx=0 tx=0).stop 2024-09-10T11:41:51.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.443+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 msgr2=0x7fd084156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:51.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.443+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 0x7fd084156a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00eb50 tx=0x7fd07c00c6a0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 shutdown_connections 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd0700750a0 0x7fd070077560 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0840d06f0 0x7fd084156a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0840721a0 0x7fd084159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 --2- 172.21.15.57:0/4146660955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0840706a0 0x7fd0841f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 >> 172.21.15.57:0/4146660955 conn(0x7fd0840d1bf0 msgr2=0x7fd08415f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 shutdown_connections 2024-09-10T11:41:51.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:51.444+0000 7fd08a7c3640 1 -- 172.21.15.57:0/4146660955 wait complete. 2024-09-10T11:41:54.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:54.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 -- 172.21.15.57:0/3072933316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80d48e0 msgr2=0x7f41e80cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 --2- 172.21.15.57:0/3072933316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80d48e0 0x7f41e80cf1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009830 tx=0x7f41d802a510 comp rx=0 tx=0).stop 2024-09-10T11:41:54.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 -- 172.21.15.57:0/3072933316 shutdown_connections 2024-09-10T11:41:54.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 --2- 172.21.15.57:0/3072933316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80cf730 0x7f41e81601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 --2- 172.21.15.57:0/3072933316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80d48e0 0x7f41e80cf1f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 -- 172.21.15.57:0/3072933316 >> 172.21.15.57:0/3072933316 conn(0x7f41e80d3dc0 msgr2=0x7f41e80d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 -- 172.21.15.57:0/3072933316 shutdown_connections 2024-09-10T11:41:54.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.602+0000 7f41f007c640 1 -- 172.21.15.57:0/3072933316 wait complete. 2024-09-10T11:41:54.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.605+0000 7f41f007c640 1 Processor -- start 2024-09-10T11:41:54.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.605+0000 7f41f007c640 1 -- start start 2024-09-10T11:41:54.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41f007c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 0x7f41e80c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41f007c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 0x7f41e81f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41ede18640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 0x7f41e80c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41f007c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e81f52d0 0x7f41e80b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41ede18640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 0x7f41e80c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59354/0 (socket says 172.21.15.57:59354) 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41ed617640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 0x7f41e81f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41f007c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8160be0 con 0x7f41e80cf730 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41f007c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41e8160a60 con 0x7f41e81f52d0 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41f007c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f41e8160d60 con 0x7f41e80d48e0 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41ed617640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 0x7f41e81f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:39240/0 (socket says 172.21.15.57:39240) 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41ed617640 1 -- 172.21.15.57:0/2261763896 learned_addr learned my addr 172.21.15.57:0/2261763896 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:54.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.607+0000 7f41ee619640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e81f52d0 0x7f41e80b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ee619640 1 -- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 msgr2=0x7f41e81f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ee619640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 0x7f41e81f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ee619640 1 -- 172.21.15.57:0/2261763896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 msgr2=0x7f41e80c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ee619640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 0x7f41e80c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ee619640 1 -- 172.21.15.57:0/2261763896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e80c7da0 con 0x7f41e81f52d0 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ede18640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 0x7f41e80c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ed617640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 0x7f41e81f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41ee619640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e81f52d0 0x7f41e80b7c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f41e000ec80 tx=0x7f41e000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0003b70 con 0x7f41e81f52d0 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41e000ee90 con 0x7f41e81f52d0 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.608+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e80c9420 con 0x7f41e81f52d0 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.609+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0004020 con 0x7f41e81f52d0 2024-09-10T11:41:54.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.609+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e80c99e0 con 0x7f41e81f52d0 2024-09-10T11:41:54.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.610+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e81612f0 con 0x7f41e81f52d0 2024-09-10T11:41:54.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.610+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f41e00041c0 con 0x7f41e81f52d0 2024-09-10T11:41:54.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.611+0000 7f41de7fc640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41cc0750d0 0x7f41cc077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:54.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.611+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f41e0096df0 con 0x7f41e81f52d0 2024-09-10T11:41:54.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.611+0000 7f41ede18640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41cc0750d0 0x7f41cc077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:54.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.612+0000 7f41ede18640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41cc0750d0 0x7f41cc077590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000f60 tx=0x7f41e4009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.617+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f41e0060b10 con 0x7f41e81f52d0 2024-09-10T11:41:54.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.941+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f41e81618a0 con 0x7f41e81f52d0 2024-09-10T11:41:54.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.942+0000 7f41de7fc640 1 -- 172.21.15.57:0/2261763896 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f41e00652d0 con 0x7f41e81f52d0 2024-09-10T11:41:54.943 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41cc0750d0 msgr2=0x7f41cc077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41cc0750d0 0x7f41cc077590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000f60 tx=0x7f41e4009040 comp rx=0 tx=0).stop 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e81f52d0 msgr2=0x7f41e80b7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e81f52d0 0x7f41e80b7c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f41e000ec80 tx=0x7f41e000c6a0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 shutdown_connections 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f41cc0750d0 0x7f41cc077590 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e81f52d0 0x7f41e80b7c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e80d48e0 0x7f41e81f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 --2- 172.21.15.57:0/2261763896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41e80cf730 0x7f41e80c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 >> 172.21.15.57:0/2261763896 conn(0x7f41e80d3dc0 msgr2=0x7f41e80cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 shutdown_connections 2024-09-10T11:41:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:54.945+0000 7f41f007c640 1 -- 172.21.15.57:0/2261763896 wait complete. 2024-09-10T11:41:57.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:41:58.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.098+0000 7f31d12cd640 1 -- 172.21.15.57:0/3844954521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0730a0 msgr2=0x7f31cc0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.098+0000 7f31d12cd640 1 --2- 172.21.15.57:0/3844954521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0730a0 0x7f31cc0734c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f31c4005fd0 tx=0x7f31c402a8b0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.098+0000 7f31d12cd640 1 -- 172.21.15.57:0/3844954521 shutdown_connections 2024-09-10T11:41:58.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.098+0000 7f31d12cd640 1 --2- 172.21.15.57:0/3844954521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0730a0 0x7f31cc0734c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.098+0000 7f31d12cd640 1 -- 172.21.15.57:0/3844954521 >> 172.21.15.57:0/3844954521 conn(0x7f31cc0d09a0 msgr2=0x7f31cc0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.099+0000 7f31d12cd640 1 -- 172.21.15.57:0/3844954521 shutdown_connections 2024-09-10T11:41:58.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.099+0000 7f31d12cd640 1 -- 172.21.15.57:0/3844954521 wait complete. 2024-09-10T11:41:58.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.101+0000 7f31d12cd640 1 Processor -- start 2024-09-10T11:41:58.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.101+0000 7f31d12cd640 1 -- start start 2024-09-10T11:41:58.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.102+0000 7f31d12cd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc0730a0 0x7f31cc1efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.102+0000 7f31d12cd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 0x7f31cc0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.102+0000 7f31d12cd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc15a860 0x7f31cc0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31d12cd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc0708d0 con 0x7f31cc15a860 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31d12cd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc070750 con 0x7f31cc0cb590 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31d12cd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc070a50 con 0x7f31cc0730a0 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 0x7f31cc0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 0x7f31cc0ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:50644/0 (socket says 172.21.15.57:50644) 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31caffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc0730a0 0x7f31cc1efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 -- 172.21.15.57:0/759771359 learned_addr learned my addr 172.21.15.57:0/759771359 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31cb7fe640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc15a860 0x7f31cc0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 -- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc0730a0 msgr2=0x7f31cc1efa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc0730a0 0x7f31cc1efa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 -- 172.21.15.57:0/759771359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc15a860 msgr2=0x7f31cc0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc15a860 0x7f31cc0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 -- 172.21.15.57:0/759771359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc0c41e0 con 0x7f31cc0cb590 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.103+0000 7f31ca7fc640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 0x7f31cc0ca970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c490 tx=0x7f31c000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.104+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0016020 con 0x7f31cc0cb590 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.104+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31c0012940 con 0x7f31cc0cb590 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.104+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0012d90 con 0x7f31cc0cb590 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.104+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc0b5360 con 0x7f31cc0cb590 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.104+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc0b5920 con 0x7f31cc0cb590 2024-09-10T11:41:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.106+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc0b5b20 con 0x7f31cc0cb590 2024-09-10T11:41:58.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.107+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f31c0019020 con 0x7f31cc0cb590 2024-09-10T11:41:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.107+0000 7f31b37fe640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:41:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.107+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f31c0096240 con 0x7f31cc0cb590 2024-09-10T11:41:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.107+0000 7f31caffd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:41:58.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.108+0000 7f31caffd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31bc005610 tx=0x7f31bc007e50 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:41:58.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.113+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f31cc0b5b20 con 0x7f31cc0cb590 2024-09-10T11:41:58.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.405+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31cc070ff0 con 0x7f31cc0cb590 2024-09-10T11:41:58.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.406+0000 7f31b37fe640 1 -- 172.21.15.57:0/759771359 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f31c0020020 con 0x7f31cc0cb590 2024-09-10T11:41:58.407 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:41:58.407 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:41:58.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 msgr2=0x7f31b8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31bc005610 tx=0x7f31bc007e50 comp rx=0 tx=0).stop 2024-09-10T11:41:58.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 msgr2=0x7f31cc0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:41:58.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 0x7f31cc0ca970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c490 tx=0x7f31c000c950 comp rx=0 tx=0).stop 2024-09-10T11:41:58.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 shutdown_connections 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc15a860 0x7f31cc0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc0cb590 0x7f31cc0ca970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 --2- 172.21.15.57:0/759771359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc0730a0 0x7f31cc1efa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 >> 172.21.15.57:0/759771359 conn(0x7f31cc0d09a0 msgr2=0x7f31cc0afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 shutdown_connections 2024-09-10T11:41:58.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:41:58.408+0000 7f31d12cd640 1 -- 172.21.15.57:0/759771359 wait complete. 2024-09-10T11:42:01.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:01.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 -- 172.21.15.57:0/1992540114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935415eb40 msgr2=0x7f935406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 --2- 172.21.15.57:0/1992540114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935415eb40 0x7f935406fb20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93541554a0 tx=0x7f934c02a8b0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 -- 172.21.15.57:0/1992540114 shutdown_connections 2024-09-10T11:42:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 --2- 172.21.15.57:0/1992540114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935415eb40 0x7f935406fb20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 --2- 172.21.15.57:0/1992540114 >> v2:172.21.15.57:3300/0 conn(0x7f935406e140 0x7f935415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 -- 172.21.15.57:0/1992540114 >> 172.21.15.57:0/1992540114 conn(0x7f93540b2870 msgr2=0x7f93540b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 -- 172.21.15.57:0/1992540114 shutdown_connections 2024-09-10T11:42:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.561+0000 7f935ad07640 1 -- 172.21.15.57:0/1992540114 wait complete. 2024-09-10T11:42:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.563+0000 7f935ad07640 1 Processor -- start 2024-09-10T11:42:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.563+0000 7f935ad07640 1 -- start start 2024-09-10T11:42:01.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.564+0000 7f935ad07640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935406e140 0x7f935414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.564+0000 7f935ad07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 0x7f93540b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.564+0000 7f935ad07640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f935415eb40 0x7f93541f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.564+0000 7f935ad07640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f93540701e0 con 0x7f935415eb40 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.564+0000 7f935ad07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9354070060 con 0x7f93541517e0 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.564+0000 7f935ad07640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9354070360 con 0x7f935406e140 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f93592a4640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f935415eb40 0x7f93541f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 0x7f93540b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9358aa3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935406e140 0x7f935414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 0x7f93540b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:36876/0 (socket says 172.21.15.57:36876) 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 -- 172.21.15.57:0/1055312988 learned_addr learned my addr 172.21.15.57:0/1055312988 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 -- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935406e140 msgr2=0x7f935414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935406e140 0x7f935414cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 -- 172.21.15.57:0/1055312988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f935415eb40 msgr2=0x7f93541f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f935415eb40 0x7f93541f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 -- 172.21.15.57:0/1055312988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9354159e20 con 0x7f93541517e0 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f9353fff640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 0x7f93540b1b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f934000ea60 tx=0x7f934000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934000cde0 con 0x7f93541517e0 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9340004020 con 0x7f93541517e0 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.565+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935415a100 con 0x7f93541517e0 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.566+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340004450 con 0x7f93541517e0 2024-09-10T11:42:01.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.566+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93541f5720 con 0x7f93541517e0 2024-09-10T11:42:01.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.567+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93540761a0 con 0x7f93541517e0 2024-09-10T11:42:01.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.568+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f93400035f0 con 0x7f93541517e0 2024-09-10T11:42:01.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.568+0000 7f93517fa640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f93380750a0 0x7f9338077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:01.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.569+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9340096d80 con 0x7f93541517e0 2024-09-10T11:42:01.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.569+0000 7f9358aa3640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f93380750a0 0x7f9338077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:01.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.569+0000 7f9358aa3640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f93380750a0 0x7f9338077560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9348007fd0 tx=0x7f9348001410 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:01.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.573+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f9340060aa0 con 0x7f93541517e0 2024-09-10T11:42:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.904+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f935406fb20 con 0x7f93541517e0 2024-09-10T11:42:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.905+0000 7f93517fa640 1 -- 172.21.15.57:0/1055312988 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f9340065260 con 0x7f93541517e0 2024-09-10T11:42:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f93380750a0 msgr2=0x7f9338077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f93380750a0 0x7f9338077560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9348007fd0 tx=0x7f9348001410 comp rx=0 tx=0).stop 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 msgr2=0x7f93540b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 0x7f93540b1b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f934000ea60 tx=0x7f934000ef20 comp rx=0 tx=0).stop 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 shutdown_connections 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f93380750a0 0x7f9338077560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f935415eb40 0x7f93541f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93541517e0 0x7f93540b1b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 --2- 172.21.15.57:0/1055312988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935406e140 0x7f935414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.907+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 >> 172.21.15.57:0/1055312988 conn(0x7f93540b2870 msgr2=0x7f93540b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.908+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 shutdown_connections 2024-09-10T11:42:01.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:01.908+0000 7f935ad07640 1 -- 172.21.15.57:0/1055312988 wait complete. 2024-09-10T11:42:04.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:05.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.074+0000 7fb5d2ffd640 1 -- 172.21.15.57:0/1571042748 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc02fe30 con 0x7fb5d40cf560 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 -- 172.21.15.57:0/1571042748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 msgr2=0x7fb5d415e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 --2- 172.21.15.57:0/1571042748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d415e5c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb5d408d470 tx=0x7fb5cc02aa30 comp rx=0 tx=0).stop 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 -- 172.21.15.57:0/1571042748 shutdown_connections 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 --2- 172.21.15.57:0/1571042748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d415e5c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 --2- 172.21.15.57:0/1571042748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d40d48e0 0x7fb5d40cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 --2- 172.21.15.57:0/1571042748 >> v2:172.21.15.154:3300/0 conn(0x7fb5d415e1d0 0x7fb5d40ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 -- 172.21.15.57:0/1571042748 >> 172.21.15.57:0/1571042748 conn(0x7fb5d40d3dc0 msgr2=0x7fb5d40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 -- 172.21.15.57:0/1571042748 shutdown_connections 2024-09-10T11:42:05.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.075+0000 7fb5da590640 1 -- 172.21.15.57:0/1571042748 wait complete. 2024-09-10T11:42:05.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.078+0000 7fb5da590640 1 Processor -- start 2024-09-10T11:42:05.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.078+0000 7fb5da590640 1 -- start start 2024-09-10T11:42:05.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.079+0000 7fb5da590640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:05.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.079+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d40ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58702/0 (socket says 172.21.15.57:58702) 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5da590640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d40d48e0 0x7fb5d40b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 -- 172.21.15.57:0/3115205413 learned_addr learned my addr 172.21.15.57:0/3115205413 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d40b4c50 0x7fb5d40cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d415f1f0 con 0x7fb5d40cf560 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d415f070 con 0x7fb5d40d48e0 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d415f370 con 0x7fb5d40b4c50 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d37fe640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d40d48e0 0x7fb5d40b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d8b2d640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d40b4c50 0x7fb5d40cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 -- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d40b4c50 msgr2=0x7fb5d40cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d40b4c50 0x7fb5d40cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 -- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d40d48e0 msgr2=0x7fb5d40b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:05.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d40d48e0 0x7fb5d40b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d40cc1b0 con 0x7fb5d40cf560 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.080+0000 7fb5d3fff640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d40ccf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400e790 tx=0x7fb5c400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.081+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400eea0 con 0x7fb5d40cf560 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.081+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5c400cdb0 con 0x7fb5d40cf560 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.081+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d40b5fc0 con 0x7fb5d40cf560 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.081+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4010690 con 0x7fb5d40cf560 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.081+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d40cc730 con 0x7fb5d40cf560 2024-09-10T11:42:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.083+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d4154b30 con 0x7fb5d40cf560 2024-09-10T11:42:05.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.083+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb5c4010830 con 0x7fb5d40cf560 2024-09-10T11:42:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.084+0000 7fb5d0ff9640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5c00750a0 0x7fb5c0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.084+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb5c4096d80 con 0x7fb5d40cf560 2024-09-10T11:42:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.084+0000 7fb5d37fe640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5c00750a0 0x7fb5c0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:05.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.085+0000 7fb5d37fe640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5c00750a0 0x7fb5c0077560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40b5530 tx=0x7fb5c8005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:05.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.091+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb5c40609b0 con 0x7fb5d40cf560 2024-09-10T11:42:05.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.405+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5d4160cc0 con 0x7fb5d40cf560 2024-09-10T11:42:05.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.405+0000 7fb5d0ff9640 1 -- 172.21.15.57:0/3115205413 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb5c4065170 con 0x7fb5d40cf560 2024-09-10T11:42:05.406 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:05.406 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.407+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5c00750a0 msgr2=0x7fb5c0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.407+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5c00750a0 0x7fb5c0077560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40b5530 tx=0x7fb5c8005f90 comp rx=0 tx=0).stop 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.407+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 msgr2=0x7fb5d40ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.407+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d40ccf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400e790 tx=0x7fb5c400ec50 comp rx=0 tx=0).stop 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.407+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 shutdown_connections 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.407+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5c00750a0 0x7fb5c0077560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.408+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d40b4c50 0x7fb5d40cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.408+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d40d48e0 0x7fb5d40b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.408+0000 7fb5da590640 1 --2- 172.21.15.57:0/3115205413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5d40cf560 0x7fb5d40ccf30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.408+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 >> 172.21.15.57:0/3115205413 conn(0x7fb5d40d3dc0 msgr2=0x7fb5d40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.408+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 shutdown_connections 2024-09-10T11:42:05.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:05.408+0000 7fb5da590640 1 -- 172.21.15.57:0/3115205413 wait complete. 2024-09-10T11:42:08.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:08.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 -- 172.21.15.57:0/2769433127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 msgr2=0x7faa800d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 --2- 172.21.15.57:0/2769433127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800d02d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa70009830 tx=0x7faa7002a500 comp rx=0 tx=0).stop 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 -- 172.21.15.57:0/2769433127 shutdown_connections 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 --2- 172.21.15.57:0/2769433127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800d02d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 --2- 172.21.15.57:0/2769433127 >> v2:172.21.15.154:3300/0 conn(0x7faa8015bbb0 0x7faa800cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 -- 172.21.15.57:0/2769433127 >> 172.21.15.57:0/2769433127 conn(0x7faa800d1ac0 msgr2=0x7faa800d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 -- 172.21.15.57:0/2769433127 shutdown_connections 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.567+0000 7faa87acd640 1 -- 172.21.15.57:0/2769433127 wait complete. 2024-09-10T11:42:08.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.569+0000 7faa87acd640 1 Processor -- start 2024-09-10T11:42:08.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.569+0000 7faa87acd640 1 -- start start 2024-09-10T11:42:08.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa87acd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 0x7faa800cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa87acd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa87acd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8015bbb0 0x7faa800b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa87acd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faa800d28d0 con 0x7faa800ce4d0 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa87acd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa800d2750 con 0x7faa8015bbb0 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa87acd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faa800cf090 con 0x7faa800cfe70 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 0x7faa800cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 0x7faa800cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58710/0 (socket says 172.21.15.57:58710) 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 -- 172.21.15.57:0/385668312 learned_addr learned my addr 172.21.15.57:0/385668312 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85068640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa8606a640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8015bbb0 0x7faa800b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:08.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 -- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 msgr2=0x7faa800b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 -- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8015bbb0 msgr2=0x7faa800b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8015bbb0 0x7faa800b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 -- 172.21.15.57:0/385668312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa801f5250 con 0x7faa800ce4d0 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85068640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.570+0000 7faa85869640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 0x7faa800cafd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00ea20 tx=0x7faa7c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.571+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00ce40 con 0x7faa800ce4d0 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.571+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa800b0f00 con 0x7faa800ce4d0 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.571+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa7c004020 con 0x7faa800ce4d0 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.571+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa801f4770 con 0x7faa800ce4d0 2024-09-10T11:42:08.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.571+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c004410 con 0x7faa800ce4d0 2024-09-10T11:42:08.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.572+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa800d02d0 con 0x7faa800ce4d0 2024-09-10T11:42:08.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.573+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7faa7c005030 con 0x7faa800ce4d0 2024-09-10T11:42:08.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.574+0000 7faa767fc640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7faa640750a0 0x7faa64077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:08.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.574+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7faa7c096d60 con 0x7faa800ce4d0 2024-09-10T11:42:08.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.574+0000 7faa85068640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7faa640750a0 0x7faa64077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:08.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.575+0000 7faa85068640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7faa640750a0 0x7faa64077560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa70034000 tx=0x7faa70004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:08.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.579+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7faa7c060fa0 con 0x7faa800ce4d0 2024-09-10T11:42:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.861+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa8015ca70 con 0x7faa800ce4d0 2024-09-10T11:42:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.861+0000 7faa767fc640 1 -- 172.21.15.57:0/385668312 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7faa7c0608a0 con 0x7faa800ce4d0 2024-09-10T11:42:08.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:08.862 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7faa640750a0 msgr2=0x7faa64077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7faa640750a0 0x7faa64077560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa70034000 tx=0x7faa70004730 comp rx=0 tx=0).stop 2024-09-10T11:42:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 msgr2=0x7faa800cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 0x7faa800cafd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00ea20 tx=0x7faa7c00eee0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 shutdown_connections 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7faa640750a0 0x7faa64077560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8015bbb0 0x7faa800b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cfe70 0x7faa800b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 --2- 172.21.15.57:0/385668312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa800ce4d0 0x7faa800cafd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 >> 172.21.15.57:0/385668312 conn(0x7faa800d1ac0 msgr2=0x7faa800d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 shutdown_connections 2024-09-10T11:42:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:08.864+0000 7faa87acd640 1 -- 172.21.15.57:0/385668312 wait complete. 2024-09-10T11:42:11.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.025+0000 7f8a8f840640 1 -- 172.21.15.57:0/3486819267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8815e1d0 msgr2=0x7f8a880ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.025+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3486819267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8815e1d0 0x7f8a880ceae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009830 tx=0x7f8a8402a5c0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.025+0000 7f8a8f840640 1 -- 172.21.15.57:0/3486819267 shutdown_connections 2024-09-10T11:42:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.025+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3486819267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8815e1d0 0x7f8a880ceae0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.025+0000 7f8a8f840640 1 -- 172.21.15.57:0/3486819267 >> 172.21.15.57:0/3486819267 conn(0x7f8a880d3dc0 msgr2=0x7f8a880d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.026+0000 7f8a8f840640 1 -- 172.21.15.57:0/3486819267 shutdown_connections 2024-09-10T11:42:12.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.026+0000 7f8a8f840640 1 -- 172.21.15.57:0/3486819267 wait complete. 2024-09-10T11:42:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.027+0000 7f8a8f840640 1 Processor -- start 2024-09-10T11:42:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.027+0000 7f8a8f840640 1 -- start start 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8f840640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a880cf730 0x7f8a880cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8f840640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 0x7f8a880ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8f840640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a880b3540 0x7f8a880c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8f840640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88160de0 con 0x7f8a880b3540 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8f840640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88160c60 con 0x7f8a880d48e0 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8f840640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8a88160f60 con 0x7f8a880cf730 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8d5dc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a880cf730 0x7f8a880cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 0x7f8a880ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 0x7f8a880ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:33656/0 (socket says 172.21.15.57:33656) 2024-09-10T11:42:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 -- 172.21.15.57:0/3029173054 learned_addr learned my addr 172.21.15.57:0/3029173054 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8dddd640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a880b3540 0x7f8a880c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 -- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a880cf730 msgr2=0x7f8a880cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a880cf730 0x7f8a880cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 -- 172.21.15.57:0/3029173054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a880b3540 msgr2=0x7f8a880c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a880b3540 0x7f8a880c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 -- 172.21.15.57:0/3029173054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880b3ab0 con 0x7f8a880d48e0 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8dddd640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a880b3540 0x7f8a880c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.029+0000 7f8a8cddb640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 0x7f8a880ca3e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c530 tx=0x7f8a7800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.030+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a780052d0 con 0x7f8a880d48e0 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.030+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a78005470 con 0x7f8a880d48e0 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.030+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78012870 con 0x7f8a880d48e0 2024-09-10T11:42:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.030+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a880b3d90 con 0x7f8a880d48e0 2024-09-10T11:42:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.030+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a880b4350 con 0x7f8a880d48e0 2024-09-10T11:42:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.031+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a88161410 con 0x7f8a880d48e0 2024-09-10T11:42:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.032+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8a78012a10 con 0x7f8a880d48e0 2024-09-10T11:42:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.033+0000 7f8a7dffb640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a6c0750a0 0x7f8a6c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.033+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8a78095ea0 con 0x7f8a880d48e0 2024-09-10T11:42:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.033+0000 7f8a8d5dc640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a6c0750a0 0x7f8a6c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.033+0000 7f8a8d5dc640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a6c0750a0 0x7f8a6c077560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a84034000 tx=0x7f8a84004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:12.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.039+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8a78060180 con 0x7f8a880d48e0 2024-09-10T11:42:12.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.326+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8a880b3320 con 0x7f8a880d48e0 2024-09-10T11:42:12.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.326+0000 7f8a7dffb640 1 -- 172.21.15.57:0/3029173054 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f8a7805fa80 con 0x7f8a880d48e0 2024-09-10T11:42:12.328 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:12.328 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.329+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a6c0750a0 msgr2=0x7f8a6c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.329+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a6c0750a0 0x7f8a6c077560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a84034000 tx=0x7f8a84004730 comp rx=0 tx=0).stop 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 msgr2=0x7f8a880ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 0x7f8a880ca3e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c530 tx=0x7f8a7800c9f0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 shutdown_connections 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a6c0750a0 0x7f8a6c077560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a880b3540 0x7f8a880c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a880d48e0 0x7f8a880ca3e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 --2- 172.21.15.57:0/3029173054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a880cf730 0x7f8a880cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:12.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 >> 172.21.15.57:0/3029173054 conn(0x7f8a880d3dc0 msgr2=0x7f8a880ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:12.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 shutdown_connections 2024-09-10T11:42:12.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:12.330+0000 7f8a8f840640 1 -- 172.21.15.57:0/3029173054 wait complete. 2024-09-10T11:42:15.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.489+0000 7f8c22953640 1 -- 172.21.15.57:0/869791421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c15a860 msgr2=0x7f8c1c0ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.489+0000 7f8c22953640 1 --2- 172.21.15.57:0/869791421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c15a860 0x7f8c1c0ce570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c06eb30 tx=0x7f8c0c02a4b0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.490+0000 7f8c22953640 1 -- 172.21.15.57:0/869791421 shutdown_connections 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.490+0000 7f8c22953640 1 --2- 172.21.15.57:0/869791421 >> v2:172.21.15.57:3300/0 conn(0x7f8c1c0730a0 0x7f8c1c0734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.490+0000 7f8c22953640 1 --2- 172.21.15.57:0/869791421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c15a860 0x7f8c1c0ce570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.490+0000 7f8c22953640 1 -- 172.21.15.57:0/869791421 >> 172.21.15.57:0/869791421 conn(0x7f8c1c0d09a0 msgr2=0x7f8c1c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.490+0000 7f8c22953640 1 -- 172.21.15.57:0/869791421 shutdown_connections 2024-09-10T11:42:15.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.490+0000 7f8c22953640 1 -- 172.21.15.57:0/869791421 wait complete. 2024-09-10T11:42:15.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.491+0000 7f8c22953640 1 Processor -- start 2024-09-10T11:42:15.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.492+0000 7f8c22953640 1 -- start start 2024-09-10T11:42:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c22953640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 0x7f8c1c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c22953640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0cb590 0x7f8c1c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c22953640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1c15a860 0x7f8c1c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c22953640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0706c0 con 0x7f8c1c0cb590 2024-09-10T11:42:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c22953640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c070540 con 0x7f8c1c0730a0 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c22953640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c070840 con 0x7f8c1c15a860 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 0x7f8c1c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0cb590 0x7f8c1c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 0x7f8c1c0ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:33660/0 (socket says 172.21.15.57:33660) 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 -- 172.21.15.57:0/3522656636 learned_addr learned my addr 172.21.15.57:0/3522656636 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c20ef0640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1c15a860 0x7f8c1c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 -- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1c15a860 msgr2=0x7f8c1c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1c15a860 0x7f8c1c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 -- 172.21.15.57:0/3522656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0cb590 msgr2=0x7f8c1c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0cb590 0x7f8c1c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1bfff640 1 -- 172.21.15.57:0/3522656636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c158760 con 0x7f8c1c0730a0 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.493+0000 7f8c1b7fe640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0cb590 0x7f8c1c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.494+0000 7f8c1bfff640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 0x7f8c1c0ca790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009780 tx=0x7f8c0c033c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.494+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c031d60 con 0x7f8c1c0730a0 2024-09-10T11:42:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.494+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c0c033e10 con 0x7f8c1c0730a0 2024-09-10T11:42:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.494+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c005260 con 0x7f8c1c0730a0 2024-09-10T11:42:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.494+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c0c7fe0 con 0x7f8c1c0730a0 2024-09-10T11:42:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.494+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c0c85a0 con 0x7f8c1c0730a0 2024-09-10T11:42:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.495+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c0734c0 con 0x7f8c1c0730a0 2024-09-10T11:42:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.496+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8c0c005400 con 0x7f8c1c0730a0 2024-09-10T11:42:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.497+0000 7f8c18ff9640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8c080750a0 0x7f8c08077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.497+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8c0c0b7340 con 0x7f8c1c0730a0 2024-09-10T11:42:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.497+0000 7f8c1b7fe640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8c080750a0 0x7f8c08077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.498+0000 7f8c1b7fe640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8c080750a0 0x7f8c08077560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007f90 tx=0x7f8c10010040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.501+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8c0c03f030 con 0x7f8c1c0730a0 2024-09-10T11:42:15.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.857+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8c1c0691f0 con 0x7f8c1c0730a0 2024-09-10T11:42:15.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.858+0000 7f8c18ff9640 1 -- 172.21.15.57:0/3522656636 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f8c0c081060 con 0x7f8c1c0730a0 2024-09-10T11:42:15.859 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:15.859 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8c080750a0 msgr2=0x7f8c08077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8c080750a0 0x7f8c08077560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007f90 tx=0x7f8c10010040 comp rx=0 tx=0).stop 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 msgr2=0x7f8c1c0ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 0x7f8c1c0ca790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009780 tx=0x7f8c0c033c20 comp rx=0 tx=0).stop 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 shutdown_connections 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8c080750a0 0x7f8c08077560 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1c15a860 0x7f8c1c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c0cb590 0x7f8c1c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 --2- 172.21.15.57:0/3522656636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c1c0730a0 0x7f8c1c0ca790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 >> 172.21.15.57:0/3522656636 conn(0x7f8c1c0d09a0 msgr2=0x7f8c1c0b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 shutdown_connections 2024-09-10T11:42:15.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:15.861+0000 7f8c22953640 1 -- 172.21.15.57:0/3522656636 wait complete. 2024-09-10T11:42:18.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 -- 172.21.15.57:0/2964534125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 msgr2=0x7f26080cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 --2- 172.21.15.57:0/2964534125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 0x7f26080cd2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2600009be0 tx=0x7f260002a740 comp rx=0 tx=0).stop 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 -- 172.21.15.57:0/2964534125 shutdown_connections 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 --2- 172.21.15.57:0/2964534125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 0x7f26080cd2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 -- 172.21.15.57:0/2964534125 >> 172.21.15.57:0/2964534125 conn(0x7f26080b1da0 msgr2=0x7f26080b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 -- 172.21.15.57:0/2964534125 shutdown_connections 2024-09-10T11:42:19.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.013+0000 7f2610783640 1 -- 172.21.15.57:0/2964534125 wait complete. 2024-09-10T11:42:19.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.015+0000 7f2610783640 1 Processor -- start 2024-09-10T11:42:19.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.015+0000 7f2610783640 1 -- start start 2024-09-10T11:42:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f2610783640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 0x7f26081542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f2610783640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 0x7f26080cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f2610783640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f260815c620 0x7f260815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:19.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f2610783640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f260815cb80 con 0x7f26080b28c0 2024-09-10T11:42:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f2610783640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f260815ca00 con 0x7f260815c620 2024-09-10T11:42:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f2610783640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26080cd830 con 0x7f26080cf8b0 2024-09-10T11:42:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f260e51f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 0x7f26081542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f260e51f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 0x7f26081542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53116/0 (socket says 172.21.15.57:53116) 2024-09-10T11:42:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f260e51f640 1 -- 172.21.15.57:0/2507370267 learned_addr learned my addr 172.21.15.57:0/2507370267 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:19.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f260ed20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f260815c620 0x7f260815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.016+0000 7f260dd1e640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 0x7f26080cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f260e51f640 1 -- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 msgr2=0x7f26080cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f260e51f640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 0x7f26080cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f260e51f640 1 -- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f260815c620 msgr2=0x7f260815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f260e51f640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f260815c620 0x7f260815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f260e51f640 1 -- 172.21.15.57:0/2507370267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2608154820 con 0x7f26080b28c0 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f260e51f640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 0x7f26081542e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f260400c500 tx=0x7f260400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604005480 con 0x7f26080b28c0 2024-09-10T11:42:19.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26040035f0 con 0x7f26080b28c0 2024-09-10T11:42:19.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.017+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26080cb7c0 con 0x7f26080b28c0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.018+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604003a40 con 0x7f26080b28c0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.018+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26080c7f40 con 0x7f26080b28c0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.019+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26080cf1a0 con 0x7f26080b28c0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.019+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2604003be0 con 0x7f26080b28c0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.020+0000 7f25feffd640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f25ec075240 0x7f25ec077700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.020+0000 7f260dd1e640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f25ec075240 0x7f25ec077700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.020+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2604095f70 con 0x7f26080b28c0 2024-09-10T11:42:19.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.021+0000 7f260dd1e640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f25ec075240 0x7f25ec077700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26080ca2a0 tx=0x7f25f8009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:19.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.024+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f26080cb7c0 con 0x7f26080b28c0 2024-09-10T11:42:19.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.358+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26080c6fa0 con 0x7f26080b28c0 2024-09-10T11:42:19.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.359+0000 7f25feffd640 1 -- 172.21.15.57:0/2507370267 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f260405fc10 con 0x7f26080b28c0 2024-09-10T11:42:19.361 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:19.361 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f25ec075240 msgr2=0x7f25ec077700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f25ec075240 0x7f25ec077700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26080ca2a0 tx=0x7f25f8009040 comp rx=0 tx=0).stop 2024-09-10T11:42:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 msgr2=0x7f26081542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:19.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 0x7f26081542e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f260400c500 tx=0x7f260400c9c0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 shutdown_connections 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f25ec075240 0x7f25ec077700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f260815c620 0x7f260815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26080cf8b0 0x7f26080cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 --2- 172.21.15.57:0/2507370267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26080b28c0 0x7f26081542e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 >> 172.21.15.57:0/2507370267 conn(0x7f26080b1da0 msgr2=0x7f260815e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 shutdown_connections 2024-09-10T11:42:19.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:19.361+0000 7f2610783640 1 -- 172.21.15.57:0/2507370267 wait complete. 2024-09-10T11:42:22.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.500+0000 7f23c01bb640 1 -- 172.21.15.57:0/3943333897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b80730a0 msgr2=0x7f23b80734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.500+0000 7f23c01bb640 1 --2- 172.21.15.57:0/3943333897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b80730a0 0x7f23b80734c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009830 tx=0x7f23a802a500 comp rx=0 tx=0).stop 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.501+0000 7f23c01bb640 1 -- 172.21.15.57:0/3943333897 shutdown_connections 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.501+0000 7f23c01bb640 1 --2- 172.21.15.57:0/3943333897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b80730a0 0x7f23b80734c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.501+0000 7f23c01bb640 1 --2- 172.21.15.57:0/3943333897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b815f0e0 0x7f23b806d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.501+0000 7f23c01bb640 1 -- 172.21.15.57:0/3943333897 >> 172.21.15.57:0/3943333897 conn(0x7f23b80d0a60 msgr2=0x7f23b80d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.501+0000 7f23c01bb640 1 -- 172.21.15.57:0/3943333897 shutdown_connections 2024-09-10T11:42:22.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.501+0000 7f23c01bb640 1 -- 172.21.15.57:0/3943333897 wait complete. 2024-09-10T11:42:22.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.503+0000 7f23c01bb640 1 Processor -- start 2024-09-10T11:42:22.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.503+0000 7f23c01bb640 1 -- start start 2024-09-10T11:42:22.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23c01bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 0x7f23b80b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23c01bb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b80730a0 0x7f23b80cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23c01bb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b815f0e0 0x7f23b80ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23c01bb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f23b806e7b0 con 0x7f23b80730a0 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23c01bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23b806e630 con 0x7f23b806df90 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23c01bb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f23b81f7a30 con 0x7f23b815f0e0 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 0x7f23b80b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 0x7f23b80b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:37116/0 (socket says 172.21.15.57:37116) 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 -- 172.21.15.57:0/989188203 learned_addr learned my addr 172.21.15.57:0/989188203 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23be758640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b815f0e0 0x7f23b80ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bd756640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b80730a0 0x7f23b80cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 -- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b815f0e0 msgr2=0x7f23b80ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b815f0e0 0x7f23b80ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 -- 172.21.15.57:0/989188203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b80730a0 msgr2=0x7f23b80cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b80730a0 0x7f23b80cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 -- 172.21.15.57:0/989188203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b81f7c80 con 0x7f23b806df90 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.504+0000 7f23bdf57640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 0x7f23b80b6e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f23b400e9f0 tx=0x7f23b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.505+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b400cd80 con 0x7f23b806df90 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.505+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b4004020 con 0x7f23b806df90 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.505+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4004470 con 0x7f23b806df90 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.505+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b81f7f60 con 0x7f23b806df90 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.505+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b81f8520 con 0x7f23b806df90 2024-09-10T11:42:22.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.506+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b80b4af0 con 0x7f23b806df90 2024-09-10T11:42:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.507+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f23b4005030 con 0x7f23b806df90 2024-09-10T11:42:22.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.508+0000 7f23ae7fc640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f239c0750a0 0x7f239c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:22.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.508+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f23b4096ba0 con 0x7f23b806df90 2024-09-10T11:42:22.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.508+0000 7f23bd756640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f239c0750a0 0x7f239c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:22.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.509+0000 7f23bd756640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f239c0750a0 0x7f239c077560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f23a8034000 tx=0x7f23a8004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.514+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f23b4060830 con 0x7f23b806df90 2024-09-10T11:42:22.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.884+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23b80b1fa0 con 0x7f23b806df90 2024-09-10T11:42:22.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.884+0000 7f23ae7fc640 1 -- 172.21.15.57:0/989188203 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f23b4064ff0 con 0x7f23b806df90 2024-09-10T11:42:22.887 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:22.887 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f239c0750a0 msgr2=0x7f239c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f239c0750a0 0x7f239c077560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f23a8034000 tx=0x7f23a8004730 comp rx=0 tx=0).stop 2024-09-10T11:42:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 msgr2=0x7f23b80b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:22.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 0x7f23b80b6e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f23b400e9f0 tx=0x7f23b400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 shutdown_connections 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f239c0750a0 0x7f239c077560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b815f0e0 0x7f23b80ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23b80730a0 0x7f23b80cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 --2- 172.21.15.57:0/989188203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b806df90 0x7f23b80b6e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 >> 172.21.15.57:0/989188203 conn(0x7f23b80d0a60 msgr2=0x7f23b80b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 shutdown_connections 2024-09-10T11:42:22.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:22.887+0000 7f23c01bb640 1 -- 172.21.15.57:0/989188203 wait complete. 2024-09-10T11:42:25.901 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:26.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.052+0000 7fdef4956640 1 -- 172.21.15.57:0/3963766302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef00d48e0 msgr2=0x7fdef00cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:26.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.052+0000 7fdef4956640 1 --2- 172.21.15.57:0/3963766302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef00d48e0 0x7fdef00cf1f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009830 tx=0x7fdee402a510 comp rx=0 tx=0).stop 2024-09-10T11:42:26.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.052+0000 7fdef4956640 1 -- 172.21.15.57:0/3963766302 shutdown_connections 2024-09-10T11:42:26.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.052+0000 7fdef4956640 1 --2- 172.21.15.57:0/3963766302 >> v2:172.21.15.154:3300/0 conn(0x7fdef00cf730 0x7fdef01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.052+0000 7fdef4956640 1 --2- 172.21.15.57:0/3963766302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef00d48e0 0x7fdef00cf1f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.053+0000 7fdef4956640 1 -- 172.21.15.57:0/3963766302 >> 172.21.15.57:0/3963766302 conn(0x7fdef00d3dc0 msgr2=0x7fdef00d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:26.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.053+0000 7fdef4956640 1 -- 172.21.15.57:0/3963766302 shutdown_connections 2024-09-10T11:42:26.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.053+0000 7fdef4956640 1 -- 172.21.15.57:0/3963766302 wait complete. 2024-09-10T11:42:26.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.054+0000 7fdef4956640 1 Processor -- start 2024-09-10T11:42:26.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.055+0000 7fdef4956640 1 -- start start 2024-09-10T11:42:26.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.055+0000 7fdef4956640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 0x7fdef01f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.055+0000 7fdef4956640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdef00d48e0 0x7fdef01f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.055+0000 7fdef4956640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef01f48e0 0x7fdef01f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdef4956640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0160c10 con 0x7fdef00d48e0 2024-09-10T11:42:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdef4956640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0160a90 con 0x7fdef00cf730 2024-09-10T11:42:26.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdef4956640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdef0160d90 con 0x7fdef01f48e0 2024-09-10T11:42:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 0x7fdef01f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeedd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdef00d48e0 0x7fdef01f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 0x7fdef01f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:37122/0 (socket says 172.21.15.57:37122) 2024-09-10T11:42:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeeed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef01f48e0 0x7fdef01f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:26.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 -- 172.21.15.57:0/3615681283 learned_addr learned my addr 172.21.15.57:0/3615681283 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 -- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef01f48e0 msgr2=0x7fdef01f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef01f48e0 0x7fdef01f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 -- 172.21.15.57:0/3615681283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdef00d48e0 msgr2=0x7fdef01f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdef00d48e0 0x7fdef01f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 -- 172.21.15.57:0/3615681283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef00cc190 con 0x7fdef00cf730 2024-09-10T11:42:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeeed9d640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef01f48e0 0x7fdef01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdeee59c640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 0x7fdef01f7ed0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c490 tx=0x7fdee000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.056+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0016020 con 0x7fdef00cf730 2024-09-10T11:42:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.057+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdee0012940 con 0x7fdef00cf730 2024-09-10T11:42:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.057+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0012d90 con 0x7fdef00cf730 2024-09-10T11:42:26.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.057+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef00cc470 con 0x7fdef00cf730 2024-09-10T11:42:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.057+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef01f5ab0 con 0x7fdef00cf730 2024-09-10T11:42:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.058+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef0161320 con 0x7fdef00cf730 2024-09-10T11:42:26.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.059+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fdee0019020 con 0x7fdef00cf730 2024-09-10T11:42:26.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.059+0000 7fdedeffd640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fded00750d0 0x7fded0077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:26.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.060+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fdee0095e30 con 0x7fdef00cf730 2024-09-10T11:42:26.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.060+0000 7fdeedd9b640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fded00750d0 0x7fded0077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:26.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.060+0000 7fdeedd9b640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fded00750d0 0x7fded0077590 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdee4034000 tx=0x7fdee4004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:26.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.063+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fdee0020030 con 0x7fdef00cf730 2024-09-10T11:42:26.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.425+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdef01618a0 con 0x7fdef00cf730 2024-09-10T11:42:26.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.425+0000 7fdedeffd640 1 -- 172.21.15.57:0/3615681283 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fdee005fac0 con 0x7fdef00cf730 2024-09-10T11:42:26.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:26.428 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fded00750d0 msgr2=0x7fded0077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fded00750d0 0x7fded0077590 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdee4034000 tx=0x7fdee4004730 comp rx=0 tx=0).stop 2024-09-10T11:42:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 msgr2=0x7fdef01f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 0x7fdef01f7ed0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdee000c490 tx=0x7fdee000c950 comp rx=0 tx=0).stop 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 shutdown_connections 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fded00750d0 0x7fded0077590 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdef01f48e0 0x7fdef01f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdef00d48e0 0x7fdef01f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 --2- 172.21.15.57:0/3615681283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdef00cf730 0x7fdef01f7ed0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 >> 172.21.15.57:0/3615681283 conn(0x7fdef00d3dc0 msgr2=0x7fdef00b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 shutdown_connections 2024-09-10T11:42:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:26.428+0000 7fdef4956640 1 -- 172.21.15.57:0/3615681283 wait complete. 2024-09-10T11:42:29.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:29.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.582+0000 7f395cd44640 1 -- 172.21.15.57:0/3355089302 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948031b90 con 0x7f39580d48e0 2024-09-10T11:42:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 -- 172.21.15.57:0/3355089302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 msgr2=0x7f39580cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3355089302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580cf1f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3948009830 tx=0x7f394802a5c0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 -- 172.21.15.57:0/3355089302 shutdown_connections 2024-09-10T11:42:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3355089302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580cf1f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 -- 172.21.15.57:0/3355089302 >> 172.21.15.57:0/3355089302 conn(0x7f39580d3dc0 msgr2=0x7f39580d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 -- 172.21.15.57:0/3355089302 shutdown_connections 2024-09-10T11:42:29.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.583+0000 7f395ffaa640 1 -- 172.21.15.57:0/3355089302 wait complete. 2024-09-10T11:42:29.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.586+0000 7f395ffaa640 1 Processor -- start 2024-09-10T11:42:29.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.586+0000 7f395ffaa640 1 -- start start 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395ffaa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 0x7f39581f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395ffaa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395ffaa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39581f7ed0 0x7f39581f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395dd46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 0x7f39581f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395d545640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395dd46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 0x7f39581f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:35934/0 (socket says 172.21.15.57:35934) 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395d545640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43846/0 (socket says 172.21.15.57:43846) 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395dd46640 1 -- 172.21.15.57:0/3263334406 learned_addr learned my addr 172.21.15.57:0/3263334406 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395e547640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39581f7ed0 0x7f39581f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.588+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3958160e30 con 0x7f39580d48e0 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3958160cb0 con 0x7f39580cf730 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3958160fb0 con 0x7f39581f7ed0 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395dd46640 1 -- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39581f7ed0 msgr2=0x7f39581f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395dd46640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39581f7ed0 0x7f39581f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395dd46640 1 -- 172.21.15.57:0/3263334406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 msgr2=0x7f39580c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395dd46640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395dd46640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3958150ad0 con 0x7f39580cf730 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.589+0000 7f395dd46640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 0x7f39581f1eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f395400c3f0 tx=0x7f395400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.590+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954017070 con 0x7f39580cf730 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.590+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39540035f0 con 0x7f39580cf730 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.590+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954003a40 con 0x7f39580cf730 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.590+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39580b7e90 con 0x7f39580cf730 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.590+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39580c9360 con 0x7f39580cf730 2024-09-10T11:42:29.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.591+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3958161410 con 0x7f39580cf730 2024-09-10T11:42:29.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.591+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f395401a070 con 0x7f39580cf730 2024-09-10T11:42:29.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.592+0000 7f394e7fc640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f393c0750a0 0x7f393c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:29.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.592+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f39540955e0 con 0x7f39580cf730 2024-09-10T11:42:29.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.592+0000 7f395d545640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f393c0750a0 0x7f393c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:29.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.593+0000 7f395d545640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f393c0750a0 0x7f393c077560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3948034000 tx=0x7f3948004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:29.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.597+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f395405f2a0 con 0x7f39580cf730 2024-09-10T11:42:29.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.895+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f39580b6790 con 0x7f39580cf730 2024-09-10T11:42:29.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.896+0000 7f394e7fc640 1 -- 172.21.15.57:0/3263334406 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f3954063a60 con 0x7f39580cf730 2024-09-10T11:42:29.898 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:29.898 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f393c0750a0 msgr2=0x7f393c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f393c0750a0 0x7f393c077560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3948034000 tx=0x7f3948004730 comp rx=0 tx=0).stop 2024-09-10T11:42:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 msgr2=0x7f39581f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:29.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 0x7f39581f1eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f395400c3f0 tx=0x7f395400c8b0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 shutdown_connections 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f393c0750a0 0x7f393c077560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39581f7ed0 0x7f39581f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39580d48e0 0x7f39580c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 --2- 172.21.15.57:0/3263334406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39580cf730 0x7f39581f1eb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 >> 172.21.15.57:0/3263334406 conn(0x7f39580d3dc0 msgr2=0x7f39580cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 shutdown_connections 2024-09-10T11:42:29.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:29.899+0000 7f395ffaa640 1 -- 172.21.15.57:0/3263334406 wait complete. 2024-09-10T11:42:32.917 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/4215685630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 msgr2=0x7f6c84168b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/4215685630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c84168b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c8415fbb0 tx=0x7f6c7c02a920 comp rx=0 tx=0).stop 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/4215685630 shutdown_connections 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/4215685630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c84168b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/4215685630 >> 172.21.15.57:0/4215685630 conn(0x7f6c840d3dc0 msgr2=0x7f6c840d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/4215685630 shutdown_connections 2024-09-10T11:42:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.061+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/4215685630 wait complete. 2024-09-10T11:42:33.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.063+0000 7f6c8aeb0640 1 Processor -- start 2024-09-10T11:42:33.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.063+0000 7f6c8aeb0640 1 -- start start 2024-09-10T11:42:33.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8aeb0640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 0x7f6c8414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8aeb0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c841f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c88c4c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 0x7f6c8414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c88c4c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 0x7f6c8414ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43850/0 (socket says 172.21.15.57:43850) 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8aeb0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c840b62e0 0x7f6c841f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c88c4c640 1 -- 172.21.15.57:0/992793872 learned_addr learned my addr 172.21.15.57:0/992793872 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84169440 con 0x7f6c840d48e0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841692c0 con 0x7f6c840b62e0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c841695c0 con 0x7f6c841611b0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c83fff640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c841f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.064+0000 7f6c8944d640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c840b62e0 0x7f6c841f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c83fff640 1 -- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c840b62e0 msgr2=0x7f6c841f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c83fff640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c840b62e0 0x7f6c841f8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c83fff640 1 -- 172.21.15.57:0/992793872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 msgr2=0x7f6c8414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c83fff640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 0x7f6c8414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c83fff640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8414e2f0 con 0x7f6c841611b0 2024-09-10T11:42:33.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c88c4c640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 0x7f6c8414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c8944d640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c840b62e0 0x7f6c841f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c83fff640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c841f5b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c3c0 tx=0x7f6c7000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70017070 con 0x7f6c841611b0 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c700053c0 con 0x7f6c841611b0 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70003850 con 0x7f6c841611b0 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c841f9050 con 0x7f6c841611b0 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.065+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c841f5320 con 0x7f6c841611b0 2024-09-10T11:42:33.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.067+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c841f5140 con 0x7f6c841611b0 2024-09-10T11:42:33.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.068+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f6c7001a070 con 0x7f6c841611b0 2024-09-10T11:42:33.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.068+0000 7f6c817fa640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c680750a0 0x7f6c68077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:33.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.068+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f6c70095650 con 0x7f6c841611b0 2024-09-10T11:42:33.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.068+0000 7f6c88c4c640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c680750a0 0x7f6c68077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:33.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.069+0000 7f6c88c4c640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c680750a0 0x7f6c68077560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c780046b0 tx=0x7f6c78007e80 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:33.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.074+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f6c841f5140 con 0x7f6c841611b0 2024-09-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.425+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c840ceae0 con 0x7f6c841611b0 2024-09-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.426+0000 7f6c817fa640 1 -- 172.21.15.57:0/992793872 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f6c7005f2e0 con 0x7f6c841611b0 2024-09-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:33.428 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:33.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c680750a0 msgr2=0x7f6c68077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c680750a0 0x7f6c68077560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c780046b0 tx=0x7f6c78007e80 comp rx=0 tx=0).stop 2024-09-10T11:42:33.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 msgr2=0x7f6c841f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c841f5b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c3c0 tx=0x7f6c7000c880 comp rx=0 tx=0).stop 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 shutdown_connections 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f6c680750a0 0x7f6c68077560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c840b62e0 0x7f6c841f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c841611b0 0x7f6c841f5b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 --2- 172.21.15.57:0/992793872 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c840d48e0 0x7f6c8414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 >> 172.21.15.57:0/992793872 conn(0x7f6c840d3dc0 msgr2=0x7f6c8415a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 shutdown_connections 2024-09-10T11:42:33.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:33.429+0000 7f6c8aeb0640 1 -- 172.21.15.57:0/992793872 wait complete. 2024-09-10T11:42:36.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.597+0000 7f1805d9b640 1 -- 172.21.15.57:0/2613124194 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc032890 con 0x7f180806d220 2024-09-10T11:42:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 -- 172.21.15.57:0/2613124194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 msgr2=0x7f18080b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2613124194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 0x7f18080b45a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009860 tx=0x7f17fc02a3b0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 -- 172.21.15.57:0/2613124194 shutdown_connections 2024-09-10T11:42:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2613124194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18080cc5e0 0x7f18080cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2613124194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 0x7f18080b45a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 -- 172.21.15.57:0/2613124194 >> 172.21.15.57:0/2613124194 conn(0x7f18080b1780 msgr2=0x7f18080b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 -- 172.21.15.57:0/2613124194 shutdown_connections 2024-09-10T11:42:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.598+0000 7f180d0b6640 1 -- 172.21.15.57:0/2613124194 wait complete. 2024-09-10T11:42:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.600+0000 7f180d0b6640 1 Processor -- start 2024-09-10T11:42:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.600+0000 7f180d0b6640 1 -- start start 2024-09-10T11:42:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180d0b6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 0x7f1808148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180d0b6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18080cc5e0 0x7f1808148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180d0b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 0x7f180814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180d0b6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f18080cdbe0 con 0x7f180806d220 2024-09-10T11:42:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180d0b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18080cda60 con 0x7f1808152e30 2024-09-10T11:42:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180d0b6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18080cdd60 con 0x7f18080cc5e0 2024-09-10T11:42:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f1806d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 0x7f1808148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 0x7f180814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 0x7f180814ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:35944/0 (socket says 172.21.15.57:35944) 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180759e640 1 -- 172.21.15.57:0/2692900759 learned_addr learned my addr 172.21.15.57:0/2692900759 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.601+0000 7f180659c640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18080cc5e0 0x7f1808148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180759e640 1 -- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18080cc5e0 msgr2=0x7f1808148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180759e640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18080cc5e0 0x7f1808148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180759e640 1 -- 172.21.15.57:0/2692900759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 msgr2=0x7f1808148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180759e640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 0x7f1808148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180759e640 1 -- 172.21.15.57:0/2692900759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1808149690 con 0x7f1808152e30 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180759e640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 0x7f180814ca20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f180000eb40 tx=0x7f180000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800004b20 con 0x7f1808152e30 2024-09-10T11:42:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1800004ce0 con 0x7f1808152e30 2024-09-10T11:42:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800005280 con 0x7f1808152e30 2024-09-10T11:42:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1808149970 con 0x7f1808152e30 2024-09-10T11:42:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.602+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1808149f30 con 0x7f1808152e30 2024-09-10T11:42:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.604+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18080ce170 con 0x7f1808152e30 2024-09-10T11:42:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.604+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f1800005420 con 0x7f1808152e30 2024-09-10T11:42:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.605+0000 7f17ef7fe640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f17f40794b0 0x7f17f407b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.605+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1800097030 con 0x7f1808152e30 2024-09-10T11:42:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.605+0000 7f1806d9d640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f17f40794b0 0x7f17f407b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.606+0000 7f1806d9d640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f17f40794b0 0x7f17f407b970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17f80018b0 tx=0x7f17f8009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.609+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f18000613a0 con 0x7f1808152e30 2024-09-10T11:42:36.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.889+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f180815bb20 con 0x7f1808152e30 2024-09-10T11:42:36.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.889+0000 7f17ef7fe640 1 -- 172.21.15.57:0/2692900759 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1800060ca0 con 0x7f1808152e30 2024-09-10T11:42:36.891 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:36.891 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:36.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f17f40794b0 msgr2=0x7f17f407b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f17f40794b0 0x7f17f407b970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17f80018b0 tx=0x7f17f8009040 comp rx=0 tx=0).stop 2024-09-10T11:42:36.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 msgr2=0x7f180814ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:36.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 0x7f180814ca20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f180000eb40 tx=0x7f180000c2d0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 shutdown_connections 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f17f40794b0 0x7f17f407b970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808152e30 0x7f180814ca20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18080cc5e0 0x7f1808148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 --2- 172.21.15.57:0/2692900759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f180806d220 0x7f1808148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 >> 172.21.15.57:0/2692900759 conn(0x7f18080b1780 msgr2=0x7f180815e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 shutdown_connections 2024-09-10T11:42:36.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:36.892+0000 7f180d0b6640 1 -- 172.21.15.57:0/2692900759 wait complete. 2024-09-10T11:42:39.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/862337129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c780cf930 msgr2=0x7f4c780d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:40.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/862337129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c780cf930 0x7f4c780d13a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c780cfdc0 tx=0x7f4c6c02a5f0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/862337129 shutdown_connections 2024-09-10T11:42:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/862337129 >> v2:172.21.15.154:3300/0 conn(0x7f4c780d2330 0x7f4c780d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/862337129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c780cf930 0x7f4c780d13a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/862337129 >> 172.21.15.57:0/862337129 conn(0x7f4c7809cfd0 msgr2=0x7f4c780d3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/862337129 shutdown_connections 2024-09-10T11:42:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.031+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/862337129 wait complete. 2024-09-10T11:42:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.033+0000 7f4c7cbaa640 1 Processor -- start 2024-09-10T11:42:40.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.033+0000 7f4c7cbaa640 1 -- start start 2024-09-10T11:42:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7cbaa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 0x7f4c781f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7cbaa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c780d2330 0x7f4c7815e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7cbaa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7815dc10 0x7f4c7815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7cbaa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780b6f30 con 0x7f4c7815dc10 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7cbaa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780b6db0 con 0x7f4c780cf930 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7cbaa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4c780b70b0 con 0x7f4c780d2330 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c76d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7815dc10 0x7f4c7815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 0x7f4c781f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.034+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 0x7f4c781f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:49694/0 (socket says 172.21.15.57:49694) 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 -- 172.21.15.57:0/3002905918 learned_addr learned my addr 172.21.15.57:0/3002905918 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c75d9b640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c780d2330 0x7f4c7815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 -- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c780d2330 msgr2=0x7f4c7815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c780d2330 0x7f4c7815e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 -- 172.21.15.57:0/3002905918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7815dc10 msgr2=0x7f4c7815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7815dc10 0x7f4c7815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 -- 172.21.15.57:0/3002905918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c780c8ba0 con 0x7f4c780cf930 2024-09-10T11:42:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c76d9d640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7815dc10 0x7f4c7815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c75d9b640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c780d2330 0x7f4c7815e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7659c640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 0x7f4c781f3eb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c430 tx=0x7f4c6800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68017070 con 0x7f4c780cf930 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c680053e0 con 0x7f4c780cf930 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68003850 con 0x7f4c780cf930 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.035+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7815eeb0 con 0x7f4c780cf930 2024-09-10T11:42:40.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.036+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7815f470 con 0x7f4c780cf930 2024-09-10T11:42:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.037+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c780d27a0 con 0x7f4c780cf930 2024-09-10T11:42:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.038+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f4c6801a070 con 0x7f4c780cf930 2024-09-10T11:42:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.038+0000 7f4c66ffd640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4c580750a0 0x7f4c58077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.038+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4c680956e0 con 0x7f4c780cf930 2024-09-10T11:42:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.038+0000 7f4c75d9b640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4c580750a0 0x7f4c58077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.039+0000 7f4c75d9b640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4c580750a0 0x7f4c58077560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c033000 tx=0x7f4c6c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.043+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f4c6805f370 con 0x7f4c780cf930 2024-09-10T11:42:40.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.379+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4c7806d220 con 0x7f4c780cf930 2024-09-10T11:42:40.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.379+0000 7f4c66ffd640 1 -- 172.21.15.57:0/3002905918 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f4c68066e20 con 0x7f4c780cf930 2024-09-10T11:42:40.381 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:40.382 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4c580750a0 msgr2=0x7f4c58077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4c580750a0 0x7f4c58077560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c033000 tx=0x7f4c6c004730 comp rx=0 tx=0).stop 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 msgr2=0x7f4c781f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 0x7f4c781f3eb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c430 tx=0x7f4c6800c8f0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 shutdown_connections 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4c580750a0 0x7f4c58077560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c7815dc10 0x7f4c7815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c780d2330 0x7f4c7815e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 --2- 172.21.15.57:0/3002905918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c780cf930 0x7f4c781f3eb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:40.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 >> 172.21.15.57:0/3002905918 conn(0x7f4c7809cfd0 msgr2=0x7f4c78161790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:40.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 shutdown_connections 2024-09-10T11:42:40.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:40.383+0000 7f4c7cbaa640 1 -- 172.21.15.57:0/3002905918 wait complete. 2024-09-10T11:42:43.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.553+0000 7f8736cef640 1 -- 172.21.15.57:0/3050699552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87300cf730 msgr2=0x7f87301601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.553+0000 7f8736cef640 1 --2- 172.21.15.57:0/3050699552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87300cf730 0x7f87301601a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8728005fd0 tx=0x7f872802a8b0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.554+0000 7f8736cef640 1 -- 172.21.15.57:0/3050699552 shutdown_connections 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.554+0000 7f8736cef640 1 --2- 172.21.15.57:0/3050699552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87300cf730 0x7f87301601a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.554+0000 7f8736cef640 1 --2- 172.21.15.57:0/3050699552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 0x7f87300cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.554+0000 7f8736cef640 1 -- 172.21.15.57:0/3050699552 >> 172.21.15.57:0/3050699552 conn(0x7f87300d3dc0 msgr2=0x7f87300d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.554+0000 7f8736cef640 1 -- 172.21.15.57:0/3050699552 shutdown_connections 2024-09-10T11:42:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.554+0000 7f8736cef640 1 -- 172.21.15.57:0/3050699552 wait complete. 2024-09-10T11:42:43.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.555+0000 7f8736cef640 1 Processor -- start 2024-09-10T11:42:43.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.555+0000 7f8736cef640 1 -- start start 2024-09-10T11:42:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8736cef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87300cf730 0x7f87300b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8736cef640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 0x7f87301f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8736cef640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87301f55e0 0x7f873006d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8736cef640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8730160c10 con 0x7f87301f55e0 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87301f55e0 0x7f873006d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f872ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 0x7f87301f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8736cef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8730160a90 con 0x7f87300cf730 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f872ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 0x7f87301f8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:34502/0 (socket says 172.21.15.57:34502) 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f872ffff640 1 -- 172.21.15.57:0/3382552377 learned_addr learned my addr 172.21.15.57:0/3382552377 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8730160d90 con 0x7f87300d48e0 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f8734a8b640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87300cf730 0x7f87300b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 -- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 msgr2=0x7f87301f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 0x7f87301f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 -- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87300cf730 msgr2=0x7f87300b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87300cf730 0x7f87300b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 -- 172.21.15.57:0/3382552377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87301f4b20 con 0x7f87301f55e0 2024-09-10T11:42:43.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.557+0000 7f873528c640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87301f55e0 0x7f873006d4a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8728009000 tx=0x7f87280316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.558+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728040070 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.558+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8728004040 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.558+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728004450 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.558+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87300b6500 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.558+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301f50c0 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.559+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730161320 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.560+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8728039040 con 0x7f87301f55e0 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.560+0000 7f872d7fa640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87140750a0 0x7f8714077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:43.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.560+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f87280b77f0 con 0x7f87301f55e0 2024-09-10T11:42:43.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.561+0000 7f8734a8b640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87140750a0 0x7f8714077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:43.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.562+0000 7f8734a8b640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87140750a0 0x7f8714077560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8724007fd0 tx=0x7f8724001370 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.564+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8728081480 con 0x7f87301f55e0 2024-09-10T11:42:43.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.902+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f87301618a0 con 0x7f87301f55e0 2024-09-10T11:42:43.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.903+0000 7f872d7fa640 1 -- 172.21.15.57:0/3382552377 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f8728085c40 con 0x7f87301f55e0 2024-09-10T11:42:43.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:43.905 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87140750a0 msgr2=0x7f8714077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87140750a0 0x7f8714077560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8724007fd0 tx=0x7f8724001370 comp rx=0 tx=0).stop 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87301f55e0 msgr2=0x7f873006d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87301f55e0 0x7f873006d4a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8728009000 tx=0x7f87280316f0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 shutdown_connections 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87140750a0 0x7f8714077560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87301f55e0 0x7f873006d4a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87300d48e0 0x7f87301f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 --2- 172.21.15.57:0/3382552377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87300cf730 0x7f87300b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:43.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 >> 172.21.15.57:0/3382552377 conn(0x7f87300d3dc0 msgr2=0x7f87300b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:43.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 shutdown_connections 2024-09-10T11:42:43.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:43.905+0000 7f8736cef640 1 -- 172.21.15.57:0/3382552377 wait complete. 2024-09-10T11:42:46.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 -- 172.21.15.57:0/648199454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80d48e0 msgr2=0x7f04e80cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 --2- 172.21.15.57:0/648199454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80d48e0 0x7f04e80cf020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f04e808d470 tx=0x7f04d802a560 comp rx=0 tx=0).stop 2024-09-10T11:42:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 -- 172.21.15.57:0/648199454 shutdown_connections 2024-09-10T11:42:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 --2- 172.21.15.57:0/648199454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e80cf560 0x7f04e815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 --2- 172.21.15.57:0/648199454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80d48e0 0x7f04e80cf020 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 --2- 172.21.15.57:0/648199454 >> v2:172.21.15.154:3300/0 conn(0x7f04e815e1d0 0x7f04e80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 -- 172.21.15.57:0/648199454 >> 172.21.15.57:0/648199454 conn(0x7f04e80d3dc0 msgr2=0x7f04e80d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:47.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 -- 172.21.15.57:0/648199454 shutdown_connections 2024-09-10T11:42:47.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.059+0000 7f04efbaa640 1 -- 172.21.15.57:0/648199454 wait complete. 2024-09-10T11:42:47.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.061+0000 7f04efbaa640 1 Processor -- start 2024-09-10T11:42:47.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.061+0000 7f04efbaa640 1 -- start start 2024-09-10T11:42:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04efbaa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 0x7f04e80b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04efbaa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80d48e0 0x7f04e81531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04efbaa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e80b5200 0x7f04e80cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04ed946640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 0x7f04e80b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04ed946640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 0x7f04e80b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57702/0 (socket says 172.21.15.57:57702) 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04ed946640 1 -- 172.21.15.57:0/1664523113 learned_addr learned my addr 172.21.15.57:0/1664523113 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.062+0000 7f04ed145640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80d48e0 0x7f04e81531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f04e815f130 con 0x7f04e80cf560 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04e815efb0 con 0x7f04e80d48e0 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f04e815f2b0 con 0x7f04e80b5200 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ee147640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e80b5200 0x7f04e80cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed946640 1 -- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e80b5200 msgr2=0x7f04e80cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed946640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e80b5200 0x7f04e80cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed946640 1 -- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80d48e0 msgr2=0x7f04e81531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:47.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed946640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80d48e0 0x7f04e81531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed946640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e80b5d70 con 0x7f04e80cf560 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed145640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80d48e0 0x7f04e81531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04ed946640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 0x7f04e80b5830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f04e400e790 tx=0x7f04e400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400cab0 con 0x7f04e80cf560 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04e400cd40 con 0x7f04e80cf560 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4010690 con 0x7f04e80cf560 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.063+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e80b3790 con 0x7f04e80cf560 2024-09-10T11:42:47.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.064+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e80b3d50 con 0x7f04e80cf560 2024-09-10T11:42:47.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.065+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e81618a0 con 0x7f04e80cf560 2024-09-10T11:42:47.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.066+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f04e4010830 con 0x7f04e80cf560 2024-09-10T11:42:47.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.066+0000 7f04de7fc640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f04cc0750d0 0x7f04cc077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:47.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.066+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f04e4096c60 con 0x7f04e80cf560 2024-09-10T11:42:47.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.066+0000 7f04ed145640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f04cc0750d0 0x7f04cc077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:47.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.067+0000 7f04ed145640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f04cc0750d0 0x7f04cc077590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04d8033000 tx=0x7f04d8004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:47.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.073+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f04e80b5d70 con 0x7f04e80cf560 2024-09-10T11:42:47.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.417+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f04e8075e10 con 0x7f04e80cf560 2024-09-10T11:42:47.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.417+0000 7f04de7fc640 1 -- 172.21.15.57:0/1664523113 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f04e4060850 con 0x7f04e80cf560 2024-09-10T11:42:47.419 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:47.420 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:47.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f04cc0750d0 msgr2=0x7f04cc077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:47.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f04cc0750d0 0x7f04cc077590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04d8033000 tx=0x7f04d8004730 comp rx=0 tx=0).stop 2024-09-10T11:42:47.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 msgr2=0x7f04e80b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 0x7f04e80b5830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f04e400e790 tx=0x7f04e400eb90 comp rx=0 tx=0).stop 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 shutdown_connections 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f04cc0750d0 0x7f04cc077590 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e80b5200 0x7f04e80cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e80d48e0 0x7f04e81531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 --2- 172.21.15.57:0/1664523113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04e80cf560 0x7f04e80b5830 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 >> 172.21.15.57:0/1664523113 conn(0x7f04e80d3dc0 msgr2=0x7f04e8160fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 shutdown_connections 2024-09-10T11:42:47.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:47.421+0000 7f04efbaa640 1 -- 172.21.15.57:0/1664523113 wait complete. 2024-09-10T11:42:50.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 -- 172.21.15.57:0/64855456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440cb5c0 msgr2=0x7fb5440cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 --2- 172.21.15.57:0/64855456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440cb5c0 0x7fb5440cc530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005fd0 tx=0x7fb53c02a940 comp rx=0 tx=0).stop 2024-09-10T11:42:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 -- 172.21.15.57:0/64855456 shutdown_connections 2024-09-10T11:42:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 --2- 172.21.15.57:0/64855456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440cb5c0 0x7fb5440cc530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 -- 172.21.15.57:0/64855456 >> 172.21.15.57:0/64855456 conn(0x7fb5440ccc40 msgr2=0x7fb5440cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 -- 172.21.15.57:0/64855456 shutdown_connections 2024-09-10T11:42:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.581+0000 7fb548ccd640 1 -- 172.21.15.57:0/64855456 wait complete. 2024-09-10T11:42:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.583+0000 7fb548ccd640 1 Processor -- start 2024-09-10T11:42:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.583+0000 7fb548ccd640 1 -- start start 2024-09-10T11:42:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb548ccd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440704f0 0x7fb5441f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb548ccd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 0x7fb544156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb548ccd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 0x7fb54409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb548ccd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb5441592f0 con 0x7fb5440cb1e0 2024-09-10T11:42:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb548ccd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb544159170 con 0x7fb5440704f0 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb548ccd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb544159470 con 0x7fb5440cb5c0 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb541d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 0x7fb544156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 0x7fb54409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb54259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440704f0 0x7fb5441f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb541d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 0x7fb544156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36066/0 (socket says 172.21.15.57:36066) 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 0x7fb54409ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:57662/0 (socket says 172.21.15.57:57662) 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb54259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440704f0 0x7fb5441f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:54710/0 (socket says 172.21.15.57:54710) 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb541d9b640 1 -- 172.21.15.57:0/180208473 learned_addr learned my addr 172.21.15.57:0/180208473 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 -- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440704f0 msgr2=0x7fb5441f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440704f0 0x7fb5441f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 -- 172.21.15.57:0/180208473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 msgr2=0x7fb544156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 0x7fb544156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb542d9d640 1 -- 172.21.15.57:0/180208473 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5441f4710 con 0x7fb5440cb5c0 2024-09-10T11:42:50.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.584+0000 7fb541d9b640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 0x7fb544156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:50.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.585+0000 7fb542d9d640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 0x7fb54409ba60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009000 tx=0x7fb53c031e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.585+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c03e070 con 0x7fb5440cb5c0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.585+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb53c004580 con 0x7fb5440cb5c0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.585+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c030430 con 0x7fb5440cb5c0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.585+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5441f4a50 con 0x7fb5440cb5c0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.585+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5440ce110 con 0x7fb5440cb5c0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.587+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5440ce310 con 0x7fb5440cb5c0 2024-09-10T11:42:50.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.587+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb53c043460 con 0x7fb5440cb5c0 2024-09-10T11:42:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.588+0000 7fb532ffd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5240750a0 0x7fb524077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.588+0000 7fb54259c640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5240750a0 0x7fb524077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.588+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb53c0b7c20 con 0x7fb5440cb5c0 2024-09-10T11:42:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.588+0000 7fb54259c640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5240750a0 0x7fb524077560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb534007fd0 tx=0x7fb534007eb0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:50.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.594+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb5440ce310 con 0x7fb5440cb5c0 2024-09-10T11:42:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.955+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb544159920 con 0x7fb5440cb5c0 2024-09-10T11:42:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.955+0000 7fb532ffd640 1 -- 172.21.15.57:0/180208473 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb5441f4a50 con 0x7fb5440cb5c0 2024-09-10T11:42:50.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:50.957 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5240750a0 msgr2=0x7fb524077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5240750a0 0x7fb524077560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb534007fd0 tx=0x7fb534007eb0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 msgr2=0x7fb54409ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 0x7fb54409ba60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009000 tx=0x7fb53c031e20 comp rx=0 tx=0).stop 2024-09-10T11:42:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 shutdown_connections 2024-09-10T11:42:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb5240750a0 0x7fb524077560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5440cb5c0 0x7fb54409ba60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5440cb1e0 0x7fb544156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 --2- 172.21.15.57:0/180208473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5440704f0 0x7fb5441f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 >> 172.21.15.57:0/180208473 conn(0x7fb5440ccc40 msgr2=0x7fb54406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 shutdown_connections 2024-09-10T11:42:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:50.958+0000 7fb548ccd640 1 -- 172.21.15.57:0/180208473 wait complete. 2024-09-10T11:42:53.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:54.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 -- 172.21.15.57:0/485106154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 msgr2=0x7fd8981622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:54.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 --2- 172.21.15.57:0/485106154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd8981622d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd8980cf6e0 tx=0x7fd89402a670 comp rx=0 tx=0).stop 2024-09-10T11:42:54.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 -- 172.21.15.57:0/485106154 shutdown_connections 2024-09-10T11:42:54.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 --2- 172.21.15.57:0/485106154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd8981622d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 -- 172.21.15.57:0/485106154 >> 172.21.15.57:0/485106154 conn(0x7fd8980d3d60 msgr2=0x7fd8980d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:54.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 -- 172.21.15.57:0/485106154 shutdown_connections 2024-09-10T11:42:54.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.118+0000 7fd89ff64640 1 -- 172.21.15.57:0/485106154 wait complete. 2024-09-10T11:42:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.120+0000 7fd89ff64640 1 Processor -- start 2024-09-10T11:42:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.120+0000 7fd89ff64640 1 -- start start 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.121+0000 7fd89ff64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 0x7fd8981eee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.121+0000 7fd89ff64640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8980d0e80 0x7fd89815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.121+0000 7fd89ff64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd89815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.121+0000 7fd89ff64640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd8980b74d0 con 0x7fd89815df70 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.121+0000 7fd89ff64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8980d4be0 con 0x7fd8980cf9f0 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.121+0000 7fd89ff64640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd8980b7650 con 0x7fd8980d0e80 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89dd00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 0x7fd8981eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89dd00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 0x7fd8981eee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:54726/0 (socket says 172.21.15.57:54726) 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8980d0e80 0x7fd89815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89dd00640 1 -- 172.21.15.57:0/3982263906 learned_addr learned my addr 172.21.15.57:0/3982263906 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89e501640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd89815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 -- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 msgr2=0x7fd8981eee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 0x7fd8981eee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 -- 172.21.15.57:0/3982263906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 msgr2=0x7fd89815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd89815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 -- 172.21.15.57:0/3982263906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8980cbd60 con 0x7fd8980d0e80 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89dd00640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 0x7fd8981eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89e501640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd89815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:42:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.122+0000 7fd89d4ff640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8980d0e80 0x7fd89815cdf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c430 tx=0x7fd88800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.123+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888017070 con 0x7fd8980d0e80 2024-09-10T11:42:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.123+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8880053c0 con 0x7fd8980d0e80 2024-09-10T11:42:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.123+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888003850 con 0x7fd8980d0e80 2024-09-10T11:42:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.123+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89809e1c0 con 0x7fd8980d0e80 2024-09-10T11:42:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.123+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89809e780 con 0x7fd8980d0e80 2024-09-10T11:42:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.124+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8981622d0 con 0x7fd8980d0e80 2024-09-10T11:42:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.125+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd88801a070 con 0x7fd8980d0e80 2024-09-10T11:42:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.125+0000 7fd88e7fc640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd87c0750a0 0x7fd87c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.125+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd8880956e0 con 0x7fd8980d0e80 2024-09-10T11:42:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.125+0000 7fd89dd00640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd87c0750a0 0x7fd87c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.126+0000 7fd89dd00640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd87c0750a0 0x7fd87c077560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd894009230 tx=0x7fd894004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:54.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.129+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd88805f370 con 0x7fd8980d0e80 2024-09-10T11:42:54.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.530+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd898161600 con 0x7fd8980d0e80 2024-09-10T11:42:54.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.530+0000 7fd88e7fc640 1 -- 172.21.15.57:0/3982263906 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd888066e20 con 0x7fd8980d0e80 2024-09-10T11:42:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:54.531 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:54.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd87c0750a0 msgr2=0x7fd87c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:54.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd87c0750a0 0x7fd87c077560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd894009230 tx=0x7fd894004730 comp rx=0 tx=0).stop 2024-09-10T11:42:54.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8980d0e80 msgr2=0x7fd89815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:54.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8980d0e80 0x7fd89815cdf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c430 tx=0x7fd88800c8f0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 shutdown_connections 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd87c0750a0 0x7fd87c077560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd89815df70 0x7fd89815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8980d0e80 0x7fd89815cdf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 --2- 172.21.15.57:0/3982263906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8980cf9f0 0x7fd8981eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 >> 172.21.15.57:0/3982263906 conn(0x7fd8980d3d60 msgr2=0x7fd8980d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 shutdown_connections 2024-09-10T11:42:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:54.533+0000 7fd89ff64640 1 -- 172.21.15.57:0/3982263906 wait complete. 2024-09-10T11:42:57.551 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 -- 172.21.15.57:0/341339680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc0cfb60 msgr2=0x7ff8fc15edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 --2- 172.21.15.57:0/341339680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc0cfb60 0x7ff8fc15edf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009830 tx=0x7ff8f002a480 comp rx=0 tx=0).stop 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 -- 172.21.15.57:0/341339680 shutdown_connections 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 --2- 172.21.15.57:0/341339680 >> v2:172.21.15.154:3300/0 conn(0x7ff8fc15f330 0x7ff8fc15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 --2- 172.21.15.57:0/341339680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc0cfb60 0x7ff8fc15edf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 -- 172.21.15.57:0/341339680 >> 172.21.15.57:0/341339680 conn(0x7ff8fc0d0150 msgr2=0x7ff8fc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 -- 172.21.15.57:0/341339680 shutdown_connections 2024-09-10T11:42:57.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.696+0000 7ff9010f7640 1 -- 172.21.15.57:0/341339680 wait complete. 2024-09-10T11:42:57.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.698+0000 7ff9010f7640 1 Processor -- start 2024-09-10T11:42:57.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.698+0000 7ff9010f7640 1 -- start start 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.699+0000 7ff9010f7640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 0x7ff8fc152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.699+0000 7ff9010f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0cfb60 0x7ff8fc0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.699+0000 7ff9010f7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc15f330 0x7ff8fc0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.699+0000 7ff9010f7640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0733b0 con 0x7ff8fc0cf780 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.699+0000 7ff9010f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc073230 con 0x7ff8fc0cfb60 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.699+0000 7ff9010f7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc073530 con 0x7ff8fc15f330 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 0x7ff8fc152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:57.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 0x7ff8fc152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36086/0 (socket says 172.21.15.57:36086) 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 -- 172.21.15.57:0/3583973442 learned_addr learned my addr 172.21.15.57:0/3583973442 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fa59c640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0cfb60 0x7ff8fc0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fb59e640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc15f330 0x7ff8fc0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 -- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc15f330 msgr2=0x7ff8fc0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc15f330 0x7ff8fc0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 -- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0cfb60 msgr2=0x7ff8fc0afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0cfb60 0x7ff8fc0afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 -- 172.21.15.57:0/3583973442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc0b05c0 con 0x7ff8fc0cf780 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8fad9d640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 0x7ff8fc152470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c490 tx=0x7ff8ec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec016020 con 0x7ff8fc0cf780 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.700+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8ec012940 con 0x7ff8fc0cf780 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.701+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc0b08a0 con 0x7ff8fc0cf780 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.701+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec012d90 con 0x7ff8fc0cf780 2024-09-10T11:42:57.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.701+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc0b0e60 con 0x7ff8fc0cf780 2024-09-10T11:42:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.702+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc070330 con 0x7ff8fc0cf780 2024-09-10T11:42:57.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.703+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7ff8ec019020 con 0x7ff8fc0cf780 2024-09-10T11:42:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.704+0000 7ff8e37fe640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff8e80750d0 0x7ff8e8077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:42:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.704+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7ff8ec095fb0 con 0x7ff8fc0cf780 2024-09-10T11:42:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.704+0000 7ff8fa59c640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff8e80750d0 0x7ff8e8077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:42:57.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.705+0000 7ff8fa59c640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff8e80750d0 0x7ff8e8077590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0034000 tx=0x7ff8f0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:42:57.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.712+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7ff8ec020030 con 0x7ff8fc0cf780 2024-09-10T11:42:57.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.995+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8fc09c320 con 0x7ff8fc0cf780 2024-09-10T11:42:57.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.996+0000 7ff8e37fe640 1 -- 172.21.15.57:0/3583973442 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7ff8ec05fbb0 con 0x7ff8fc0cf780 2024-09-10T11:42:57.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:42:57.997 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff8e80750d0 msgr2=0x7ff8e8077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff8e80750d0 0x7ff8e8077590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0034000 tx=0x7ff8f0004730 comp rx=0 tx=0).stop 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 msgr2=0x7ff8fc152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 0x7ff8fc152470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c490 tx=0x7ff8ec00c950 comp rx=0 tx=0).stop 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 shutdown_connections 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7ff8e80750d0 0x7ff8e8077590 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8fc15f330 0x7ff8fc0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0cfb60 0x7ff8fc0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 --2- 172.21.15.57:0/3583973442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8fc0cf780 0x7ff8fc152470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 >> 172.21.15.57:0/3583973442 conn(0x7ff8fc0d0150 msgr2=0x7ff8fc0c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:42:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 shutdown_connections 2024-09-10T11:42:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:42:57.999+0000 7ff9010f7640 1 -- 172.21.15.57:0/3583973442 wait complete. 2024-09-10T11:43:01.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.147+0000 7f4bf7d64640 1 -- 172.21.15.57:0/571699415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf015eea0 msgr2=0x7f4bf00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.147+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/571699415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf015eea0 0x7f4bf00cf8a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4bec005fd0 tx=0x7f4bec02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.147+0000 7f4bf7d64640 1 -- 172.21.15.57:0/571699415 shutdown_connections 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.147+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/571699415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015f280 0x7f4bf00af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.147+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/571699415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf015eea0 0x7f4bf00cf8a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.147+0000 7f4bf7d64640 1 -- 172.21.15.57:0/571699415 >> 172.21.15.57:0/571699415 conn(0x7f4bf00d1ac0 msgr2=0x7f4bf00d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.148+0000 7f4bf7d64640 1 -- 172.21.15.57:0/571699415 shutdown_connections 2024-09-10T11:43:01.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.148+0000 7f4bf7d64640 1 -- 172.21.15.57:0/571699415 wait complete. 2024-09-10T11:43:01.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.149+0000 7f4bf7d64640 1 Processor -- start 2024-09-10T11:43:01.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.150+0000 7f4bf7d64640 1 -- start start 2024-09-10T11:43:01.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.151+0000 7f4bf7d64640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 0x7f4bf01f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.151+0000 7f4bf7d64640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015eea0 0x7f4bf01f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf7d64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf015f280 0x7f4bf01f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf7d64640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf00afd00 con 0x7f4bf00d25e0 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 0x7f4bf01f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf7d64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf00afb80 con 0x7f4bf015f280 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf7d64640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf00afe80 con 0x7f4bf015eea0 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 0x7f4bf01f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41552/0 (socket says 172.21.15.57:41552) 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 -- 172.21.15.57:0/4062524537 learned_addr learned my addr 172.21.15.57:0/4062524537 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf52ff640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015eea0 0x7f4bf01f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:01.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf6301640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf015f280 0x7f4bf01f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:01.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 -- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015eea0 msgr2=0x7f4bf01f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:01.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015eea0 0x7f4bf01f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 -- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf015f280 msgr2=0x7f4bf01f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf015f280 0x7f4bf01f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 -- 172.21.15.57:0/4062524537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf01f3490 con 0x7f4bf00d25e0 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf52ff640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015eea0 0x7f4bf01f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf6301640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf015f280 0x7f4bf01f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.152+0000 7f4bf5b00640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 0x7f4bf01f54a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.153+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec035070 con 0x7f4bf00d25e0 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.153+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf00b66b0 con 0x7f4bf00d25e0 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.153+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf00b4a00 con 0x7f4bf00d25e0 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.153+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bec005600 con 0x7f4bf00d25e0 2024-09-10T11:43:01.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.153+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec003830 con 0x7f4bf00d25e0 2024-09-10T11:43:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.154+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd8005290 con 0x7f4bf00d25e0 2024-09-10T11:43:01.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.155+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f4bec0039d0 con 0x7f4bf00d25e0 2024-09-10T11:43:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.156+0000 7f4be67fc640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4bd40750a0 0x7f4bd4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.156+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4bec0bea20 con 0x7f4bf00d25e0 2024-09-10T11:43:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.156+0000 7f4bf52ff640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4bd40750a0 0x7f4bd4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:01.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.157+0000 7f4bf52ff640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4bd40750a0 0x7f4bd4077560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4be0007fd0 tx=0x7f4be0009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:01.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.162+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f4bec0886b0 con 0x7f4bf00d25e0 2024-09-10T11:43:01.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.512+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4bd8005580 con 0x7f4bf00d25e0 2024-09-10T11:43:01.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.513+0000 7f4be67fc640 1 -- 172.21.15.57:0/4062524537 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f4bec08ce70 con 0x7f4bf00d25e0 2024-09-10T11:43:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:01.514 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:01.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4bd40750a0 msgr2=0x7f4bd4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4bd40750a0 0x7f4bd4077560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4be0007fd0 tx=0x7f4be0009040 comp rx=0 tx=0).stop 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 msgr2=0x7f4bf01f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 0x7f4bf01f54a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec004270 comp rx=0 tx=0).stop 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 shutdown_connections 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4bd40750a0 0x7f4bd4077560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf015f280 0x7f4bf01f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf015eea0 0x7f4bf01f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 --2- 172.21.15.57:0/4062524537 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00d25e0 0x7f4bf01f54a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 >> 172.21.15.57:0/4062524537 conn(0x7f4bf00d1ac0 msgr2=0x7f4bf00cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:01.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 shutdown_connections 2024-09-10T11:43:01.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:01.516+0000 7f4bf7d64640 1 -- 172.21.15.57:0/4062524537 wait complete. 2024-09-10T11:43:04.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.674+0000 7f58c6310640 1 -- 172.21.15.57:0/3491162277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00d48e0 msgr2=0x7f58c00cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.674+0000 7f58c6310640 1 --2- 172.21.15.57:0/3491162277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00d48e0 0x7f58c00cf1f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f58c008d0b0 tx=0x7f58b402a540 comp rx=0 tx=0).stop 2024-09-10T11:43:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.675+0000 7f58c6310640 1 -- 172.21.15.57:0/3491162277 shutdown_connections 2024-09-10T11:43:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.675+0000 7f58c6310640 1 --2- 172.21.15.57:0/3491162277 >> v2:172.21.15.57:3300/0 conn(0x7f58c00cf730 0x7f58c01601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.675+0000 7f58c6310640 1 --2- 172.21.15.57:0/3491162277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00d48e0 0x7f58c00cf1f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.675+0000 7f58c6310640 1 -- 172.21.15.57:0/3491162277 >> 172.21.15.57:0/3491162277 conn(0x7f58c00d3dc0 msgr2=0x7f58c00d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.675+0000 7f58c6310640 1 -- 172.21.15.57:0/3491162277 shutdown_connections 2024-09-10T11:43:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.675+0000 7f58c6310640 1 -- 172.21.15.57:0/3491162277 wait complete. 2024-09-10T11:43:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.677+0000 7f58c6310640 1 Processor -- start 2024-09-10T11:43:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.677+0000 7f58c6310640 1 -- start start 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c6310640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 0x7f58c014db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c6310640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 0x7f58c01f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c6310640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c01f8c40 0x7f58c0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c6310640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0160b60 con 0x7f58c01f8280 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c6310640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58c01609e0 con 0x7f58c00cf730 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c6310640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58c0160ce0 con 0x7f58c01f8c40 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58bffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 0x7f58c014db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58bf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 0x7f58c01f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58c48ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c01f8c40 0x7f58c0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58bffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 0x7f58c014db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:55794/0 (socket says 172.21.15.57:55794) 2024-09-10T11:43:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58bffff640 1 -- 172.21.15.57:0/3942935236 learned_addr learned my addr 172.21.15.57:0/3942935236 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.678+0000 7f58bf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 0x7f58c01f8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41558/0 (socket says 172.21.15.57:41558) 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bffff640 1 -- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c01f8c40 msgr2=0x7f58c0150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bffff640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c01f8c40 0x7f58c0150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bffff640 1 -- 172.21.15.57:0/3942935236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 msgr2=0x7f58c01f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bffff640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 0x7f58c01f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bffff640 1 -- 172.21.15.57:0/3942935236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c01f90c0 con 0x7f58c00cf730 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58c48ad640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c01f8c40 0x7f58c0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bf7fe640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 0x7f58c01f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bffff640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 0x7f58c014db80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c430 tx=0x7f58b000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.679+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0017070 con 0x7f58c00cf730 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.680+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58b00035f0 con 0x7f58c00cf730 2024-09-10T11:43:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.680+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c00ce0c0 con 0x7f58c00cf730 2024-09-10T11:43:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.680+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0003a80 con 0x7f58c00cf730 2024-09-10T11:43:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.680+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c00cd820 con 0x7f58c00cf730 2024-09-10T11:43:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.681+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c0161190 con 0x7f58c00cf730 2024-09-10T11:43:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.682+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f58b001a070 con 0x7f58c00cf730 2024-09-10T11:43:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.683+0000 7f58bcff9640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f58ac0750d0 0x7f58ac077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.683+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f58b0095610 con 0x7f58c00cf730 2024-09-10T11:43:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.683+0000 7f58bf7fe640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f58ac0750d0 0x7f58ac077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.684+0000 7f58bf7fe640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f58ac0750d0 0x7f58ac077590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58b4034000 tx=0x7f58b4004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:04.687+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f58b005f360 con 0x7f58c00cf730 2024-09-10T11:43:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.005+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f58c01618a0 con 0x7f58c00cf730 2024-09-10T11:43:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.005+0000 7f58bcff9640 1 -- 172.21.15.57:0/3942935236 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f58b0063b20 con 0x7f58c00cf730 2024-09-10T11:43:05.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:05.006 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f58ac0750d0 msgr2=0x7f58ac077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f58ac0750d0 0x7f58ac077590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58b4034000 tx=0x7f58b4004730 comp rx=0 tx=0).stop 2024-09-10T11:43:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 msgr2=0x7f58c014db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 0x7f58c014db80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c430 tx=0x7f58b000c8f0 comp rx=0 tx=0).stop 2024-09-10T11:43:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 shutdown_connections 2024-09-10T11:43:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f58ac0750d0 0x7f58ac077590 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c01f8c40 0x7f58c0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58c01f8280 0x7f58c01f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 --2- 172.21.15.57:0/3942935236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c00cf730 0x7f58c014db80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 >> 172.21.15.57:0/3942935236 conn(0x7f58c00d3dc0 msgr2=0x7f58c00b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 shutdown_connections 2024-09-10T11:43:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:05.008+0000 7f58c6310640 1 -- 172.21.15.57:0/3942935236 wait complete. 2024-09-10T11:43:08.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.170+0000 7f1d47eeb640 1 -- 172.21.15.57:0/2191828104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d4015e1d0 msgr2=0x7f1d400ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.170+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/2191828104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d4015e1d0 0x7f1d400ceae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d4008d470 tx=0x7f1d3c02a600 comp rx=0 tx=0).stop 2024-09-10T11:43:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.171+0000 7f1d47eeb640 1 -- 172.21.15.57:0/2191828104 shutdown_connections 2024-09-10T11:43:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.171+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/2191828104 >> v2:172.21.15.57:3300/0 conn(0x7f1d400cf730 0x7f1d401601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.171+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/2191828104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d4015e1d0 0x7f1d400ceae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.171+0000 7f1d47eeb640 1 -- 172.21.15.57:0/2191828104 >> 172.21.15.57:0/2191828104 conn(0x7f1d400d3dc0 msgr2=0x7f1d400d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.171+0000 7f1d47eeb640 1 -- 172.21.15.57:0/2191828104 shutdown_connections 2024-09-10T11:43:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.171+0000 7f1d47eeb640 1 -- 172.21.15.57:0/2191828104 wait complete. 2024-09-10T11:43:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.172+0000 7f1d47eeb640 1 Processor -- start 2024-09-10T11:43:08.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.172+0000 7f1d47eeb640 1 -- start start 2024-09-10T11:43:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d47eeb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d400cf730 0x7f1d400b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d47eeb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d400d48e0 0x7f1d400b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d47eeb640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 0x7f1d4006e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d47eeb640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40160b50 con 0x7f1d400b87b0 2024-09-10T11:43:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d47eeb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401609d0 con 0x7f1d400d48e0 2024-09-10T11:43:08.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d47eeb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1d40160cd0 con 0x7f1d400cf730 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d46488640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 0x7f1d4006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d46488640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 0x7f1d4006e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41576/0 (socket says 172.21.15.57:41576) 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d45486640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d400d48e0 0x7f1d400b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d46488640 1 -- 172.21.15.57:0/874863907 learned_addr learned my addr 172.21.15.57:0/874863907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.173+0000 7f1d45c87640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d400cf730 0x7f1d400b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d46488640 1 -- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d400cf730 msgr2=0x7f1d400b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:08.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d46488640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d400cf730 0x7f1d400b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d46488640 1 -- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d400d48e0 msgr2=0x7f1d400b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d46488640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d400d48e0 0x7f1d400b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d46488640 1 -- 172.21.15.57:0/874863907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d401f8eb0 con 0x7f1d400b87b0 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d45486640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d400d48e0 0x7f1d400b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d45c87640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d400cf730 0x7f1d400b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d46488640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 0x7f1d4006e220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800eb40 tx=0x7f1d3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004b20 con 0x7f1d400b87b0 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d38004ce0 con 0x7f1d400b87b0 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38005280 con 0x7f1d400b87b0 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d400b6bf0 con 0x7f1d400b87b0 2024-09-10T11:43:08.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.174+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d401f83d0 con 0x7f1d400b87b0 2024-09-10T11:43:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.176+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d40161180 con 0x7f1d400b87b0 2024-09-10T11:43:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.176+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f1d38005420 con 0x7f1d400b87b0 2024-09-10T11:43:08.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.177+0000 7f1d367fc640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1d240750a0 0x7f1d24077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.177+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1d38097090 con 0x7f1d400b87b0 2024-09-10T11:43:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.177+0000 7f1d45c87640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1d240750a0 0x7f1d24077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.178+0000 7f1d45c87640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1d240750a0 0x7f1d24077560 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c033000 tx=0x7f1d3c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:08.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.181+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f1d38061400 con 0x7f1d400b87b0 2024-09-10T11:43:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.524+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d401618a0 con 0x7f1d400b87b0 2024-09-10T11:43:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.524+0000 7f1d367fc640 1 -- 172.21.15.57:0/874863907 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f1d38061400 con 0x7f1d400b87b0 2024-09-10T11:43:08.525 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:08.525 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1d240750a0 msgr2=0x7f1d24077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1d240750a0 0x7f1d24077560 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c033000 tx=0x7f1d3c004730 comp rx=0 tx=0).stop 2024-09-10T11:43:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 msgr2=0x7f1d4006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 0x7f1d4006e220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800eb40 tx=0x7f1d3800c2d0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 shutdown_connections 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f1d240750a0 0x7f1d24077560 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d400b87b0 0x7f1d4006e220 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d400d48e0 0x7f1d400b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 --2- 172.21.15.57:0/874863907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d400cf730 0x7f1d400b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 >> 172.21.15.57:0/874863907 conn(0x7f1d400d3dc0 msgr2=0x7f1d400b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 shutdown_connections 2024-09-10T11:43:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:08.527+0000 7f1d47eeb640 1 -- 172.21.15.57:0/874863907 wait complete. 2024-09-10T11:43:11.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 -- 172.21.15.57:0/1013353786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c15f290 msgr2=0x7fa74c0cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 --2- 172.21.15.57:0/1013353786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c15f290 0x7fa74c0cfee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009850 tx=0x7fa73c02a5a0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 -- 172.21.15.57:0/1013353786 shutdown_connections 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 --2- 172.21.15.57:0/1013353786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c15f290 0x7fa74c0cfee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 -- 172.21.15.57:0/1013353786 >> 172.21.15.57:0/1013353786 conn(0x7fa74c0d1b00 msgr2=0x7fa74c0d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 -- 172.21.15.57:0/1013353786 shutdown_connections 2024-09-10T11:43:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.681+0000 7fa751c31640 1 -- 172.21.15.57:0/1013353786 wait complete. 2024-09-10T11:43:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.682+0000 7fa751c31640 1 Processor -- start 2024-09-10T11:43:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.682+0000 7fa751c31640 1 -- start start 2024-09-10T11:43:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa751c31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 0x7fa74c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa751c31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0d0420 0x7fa74c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa751c31640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa74c15f290 0x7fa74c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa751c31640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0ce030 con 0x7fa74c15f290 2024-09-10T11:43:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa751c31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0cdeb0 con 0x7fa74c0d0420 2024-09-10T11:43:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa751c31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa74c0b28e0 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa74b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 0x7fa74c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa74b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 0x7fa74c155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:50762/0 (socket says 172.21.15.57:50762) 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa74b7fe640 1 -- 172.21.15.57:0/884835275 learned_addr learned my addr 172.21.15.57:0/884835275 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa74bfff640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa74c15f290 0x7fa74c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.683+0000 7fa74affd640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0d0420 0x7fa74c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa74b7fe640 1 -- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0d0420 msgr2=0x7fa74c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa74b7fe640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0d0420 0x7fa74c15cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa74b7fe640 1 -- 172.21.15.57:0/884835275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa74c15f290 msgr2=0x7fa74c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa74b7fe640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa74c15f290 0x7fa74c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa74b7fe640 1 -- 172.21.15.57:0/884835275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c1f4a20 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa74b7fe640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 0x7fa74c155360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa73c02ab90 tx=0x7fa73c033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c03f070 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.684+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa73c033e10 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.685+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c005c30 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.685+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c1f4ce0 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.685+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c1f52a0 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.686+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c0cfee0 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.687+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa73c042070 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.688+0000 7fa733fff640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa7380750a0 0x7fa738077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.688+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa73c0b7120 con 0x7fa74c0cd6e0 2024-09-10T11:43:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.688+0000 7fa74affd640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa7380750a0 0x7fa738077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.689+0000 7fa74affd640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa7380750a0 0x7fa738077560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa740007fd0 tx=0x7fa740009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:11.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:11.692+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fa73c080d10 con 0x7fa74c0cd6e0 2024-09-10T11:43:12.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.103+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa74c070d60 con 0x7fa74c0cd6e0 2024-09-10T11:43:12.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.103+0000 7fa733fff640 1 -- 172.21.15.57:0/884835275 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa73c0854d0 con 0x7fa74c0cd6e0 2024-09-10T11:43:12.104 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:12.105 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:12.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa7380750a0 msgr2=0x7fa738077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa7380750a0 0x7fa738077560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa740007fd0 tx=0x7fa740009040 comp rx=0 tx=0).stop 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 msgr2=0x7fa74c155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 0x7fa74c155360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa73c02ab90 tx=0x7fa73c033c20 comp rx=0 tx=0).stop 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 shutdown_connections 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa7380750a0 0x7fa738077560 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa74c15f290 0x7fa74c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0d0420 0x7fa74c15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 --2- 172.21.15.57:0/884835275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cd6e0 0x7fa74c155360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.105+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 >> 172.21.15.57:0/884835275 conn(0x7fa74c0d1b00 msgr2=0x7fa74c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.106+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 shutdown_connections 2024-09-10T11:43:12.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:12.106+0000 7fa751c31640 1 -- 172.21.15.57:0/884835275 wait complete. 2024-09-10T11:43:15.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:15.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 -- 172.21.15.57:0/4111547936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d4480 msgr2=0x7f0c1c1627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:15.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/4111547936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d4480 0x7f0c1c1627c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009830 tx=0x7f0c1002a480 comp rx=0 tx=0).stop 2024-09-10T11:43:15.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 -- 172.21.15.57:0/4111547936 shutdown_connections 2024-09-10T11:43:15.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/4111547936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d0010 0x7f0c1c0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/4111547936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d4480 0x7f0c1c1627c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 -- 172.21.15.57:0/4111547936 >> 172.21.15.57:0/4111547936 conn(0x7f0c1c09cfe0 msgr2=0x7f0c1c0d3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:15.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 -- 172.21.15.57:0/4111547936 shutdown_connections 2024-09-10T11:43:15.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.267+0000 7f0c21f4b640 1 -- 172.21.15.57:0/4111547936 wait complete. 2024-09-10T11:43:15.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.269+0000 7f0c21f4b640 1 Processor -- start 2024-09-10T11:43:15.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.269+0000 7f0c21f4b640 1 -- start start 2024-09-10T11:43:15.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c21f4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 0x7f0c1c15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:15.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c21f4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 0x7f0c1c15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:15.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c21f4b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c1c0d4480 0x7f0c1c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:15.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c21f4b640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c0d2810 con 0x7f0c1c0d4480 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c21f4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c162f10 con 0x7f0c1c0d0010 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c21f4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1c0d2990 con 0x7f0c1c0d2430 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 0x7f0c1c15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 0x7f0c1c15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 0x7f0c1c15ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:35282/0 (socket says 172.21.15.57:35282) 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c1b7fe640 1 -- 172.21.15.57:0/1266897918 learned_addr learned my addr 172.21.15.57:0/1266897918 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 0x7f0c1c15d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:50768/0 (socket says 172.21.15.57:50768) 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.270+0000 7f0c1bfff640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c1c0d4480 0x7f0c1c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1b7fe640 1 -- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 msgr2=0x7f0c1c15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1b7fe640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 0x7f0c1c15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1b7fe640 1 -- 172.21.15.57:0/1266897918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c1c0d4480 msgr2=0x7f0c1c15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1b7fe640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c1c0d4480 0x7f0c1c15f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1b7fe640 1 -- 172.21.15.57:0/1266897918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c1f46b0 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1affd640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 0x7f0c1c15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c1b7fe640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 0x7f0c1c15ab70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c490 tx=0x7f0c0c00c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0052d0 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c0c005490 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c012870 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1c1f4990 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.271+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1c15fbe0 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.273+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c1c0b39b0 con 0x7f0c1c0d0010 2024-09-10T11:43:15.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.274+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0c0c012a10 con 0x7f0c1c0d0010 2024-09-10T11:43:15.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.274+0000 7f0c03fff640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0c080750d0 0x7f0c08077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:15.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.274+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f0c0c095e70 con 0x7f0c1c0d0010 2024-09-10T11:43:15.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.274+0000 7f0c1affd640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0c080750d0 0x7f0c08077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:15.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.275+0000 7f0c1affd640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0c080750d0 0x7f0c08077590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c10034000 tx=0x7f0c10004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:15.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.281+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f0c0c05fa60 con 0x7f0c1c0d0010 2024-09-10T11:43:15.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.656+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0c1c161db0 con 0x7f0c1c0d0010 2024-09-10T11:43:15.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.656+0000 7f0c03fff640 1 -- 172.21.15.57:0/1266897918 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f0c0c064220 con 0x7f0c1c0d0010 2024-09-10T11:43:15.657 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:15.657 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:15.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0c080750d0 msgr2=0x7f0c08077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:15.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0c080750d0 0x7f0c08077590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c10034000 tx=0x7f0c10004730 comp rx=0 tx=0).stop 2024-09-10T11:43:15.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 msgr2=0x7f0c1c15ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:15.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 0x7f0c1c15ab70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c490 tx=0x7f0c0c00c950 comp rx=0 tx=0).stop 2024-09-10T11:43:15.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 shutdown_connections 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f0c080750d0 0x7f0c08077590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c1c0d4480 0x7f0c1c15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c1c0d2430 0x7f0c1c15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 --2- 172.21.15.57:0/1266897918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c1c0d0010 0x7f0c1c15ab70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 >> 172.21.15.57:0/1266897918 conn(0x7f0c1c09cfe0 msgr2=0x7f0c1c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 shutdown_connections 2024-09-10T11:43:15.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:15.659+0000 7f0c21f4b640 1 -- 172.21.15.57:0/1266897918 wait complete. 2024-09-10T11:43:18.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:18.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 -- 172.21.15.57:0/1890745876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740cc570 msgr2=0x7f4d74073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 --2- 172.21.15.57:0/1890745876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740cc570 0x7f4d74073c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009830 tx=0x7f4d6802a480 comp rx=0 tx=0).stop 2024-09-10T11:43:18.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 -- 172.21.15.57:0/1890745876 shutdown_connections 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 --2- 172.21.15.57:0/1890745876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d7415e460 0x7f4d7415e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 --2- 172.21.15.57:0/1890745876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d740cc570 0x7f4d74073c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 -- 172.21.15.57:0/1890745876 >> 172.21.15.57:0/1890745876 conn(0x7f4d740cd430 msgr2=0x7f4d740cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 -- 172.21.15.57:0/1890745876 shutdown_connections 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.811+0000 7f4d78857640 1 -- 172.21.15.57:0/1890745876 wait complete. 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.813+0000 7f4d78857640 1 Processor -- start 2024-09-10T11:43:18.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.813+0000 7f4d78857640 1 -- start start 2024-09-10T11:43:18.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.813+0000 7f4d78857640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d740cc570 0x7f4d740c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d78857640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 0x7f4d740ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d78857640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d7415e460 0x7f4d7414d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d78857640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415b250 con 0x7f4d740cc570 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d78857640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415b0d0 con 0x7f4d7415a600 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d78857640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7415b3d0 con 0x7f4d7415e460 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 0x7f4d740ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 0x7f4d740ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:35306/0 (socket says 172.21.15.57:35306) 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 -- 172.21.15.57:0/1196351062 learned_addr learned my addr 172.21.15.57:0/1196351062 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d72d9d640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d7415e460 0x7f4d7414d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d7259c640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d740cc570 0x7f4d740c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 -- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d7415e460 msgr2=0x7f4d7414d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d7415e460 0x7f4d7414d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 -- 172.21.15.57:0/1196351062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d740cc570 msgr2=0x7f4d740c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d740cc570 0x7f4d740c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 -- 172.21.15.57:0/1196351062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d740ca8a0 con 0x7f4d7415a600 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.814+0000 7f4d71d9b640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 0x7f4d740ca360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4d68000c00 tx=0x7f4d68032c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.815+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68040070 con 0x7f4d7415a600 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.815+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d680038e0 con 0x7f4d7415a600 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.815+0000 7f4d78857640 1 -- 172.21.15.57:0/1196351062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7414dbc0 con 0x7f4d7415a600 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.815+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68003d30 con 0x7f4d7415a600 2024-09-10T11:43:18.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.815+0000 7f4d78857640 1 -- 172.21.15.57:0/1196351062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741f59c0 con 0x7f4d7415a600 2024-09-10T11:43:18.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.817+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c005290 con 0x7f4d7415a600 2024-09-10T11:43:18.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.819+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f4d68039040 con 0x7f4d7415a600 2024-09-10T11:43:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.819+0000 7f4d62ffd640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4d540750a0 0x7f4d54077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.819+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4d680b7ef0 con 0x7f4d7415a600 2024-09-10T11:43:18.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.819+0000 7f4d7259c640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4d540750a0 0x7f4d54077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:18.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.820+0000 7f4d7259c640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4d540750a0 0x7f4d54077560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d64007fd0 tx=0x7f4d64001410 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:18.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:18.823+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f4d68053080 con 0x7f4d7415a600 2024-09-10T11:43:19.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.202+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d4c005580 con 0x7f4d7415a600 2024-09-10T11:43:19.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.202+0000 7f4d62ffd640 1 -- 172.21.15.57:0/1196351062 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f4d7414dbc0 con 0x7f4d7415a600 2024-09-10T11:43:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:19.204 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4d540750a0 msgr2=0x7f4d54077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4d540750a0 0x7f4d54077560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d64007fd0 tx=0x7f4d64001410 comp rx=0 tx=0).stop 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 msgr2=0x7f4d740ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 0x7f4d740ca360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4d68000c00 tx=0x7f4d68032c10 comp rx=0 tx=0).stop 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 shutdown_connections 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4d540750a0 0x7f4d54077560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d7415e460 0x7f4d7414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d7415a600 0x7f4d740ca360 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 --2- 172.21.15.57:0/1196351062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d740cc570 0x7f4d740c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 >> 172.21.15.57:0/1196351062 conn(0x7f4d740cd430 msgr2=0x7f4d7406d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 shutdown_connections 2024-09-10T11:43:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:19.205+0000 7f4d60ff9640 1 -- 172.21.15.57:0/1196351062 wait complete. 2024-09-10T11:43:22.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 -- 172.21.15.57:0/2483136096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c1563a0 msgr2=0x7fc66c06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 --2- 172.21.15.57:0/2483136096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c1563a0 0x7fc66c06ee60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc664005fd0 tx=0x7fc66402a820 comp rx=0 tx=0).stop 2024-09-10T11:43:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 -- 172.21.15.57:0/2483136096 shutdown_connections 2024-09-10T11:43:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 --2- 172.21.15.57:0/2483136096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 --2- 172.21.15.57:0/2483136096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c1563a0 0x7fc66c06ee60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 -- 172.21.15.57:0/2483136096 >> 172.21.15.57:0/2483136096 conn(0x7fc66c0d09d0 msgr2=0x7fc66c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 -- 172.21.15.57:0/2483136096 shutdown_connections 2024-09-10T11:43:22.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.371+0000 7fc672989640 1 -- 172.21.15.57:0/2483136096 wait complete. 2024-09-10T11:43:22.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.373+0000 7fc672989640 1 Processor -- start 2024-09-10T11:43:22.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.373+0000 7fc672989640 1 -- start start 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.374+0000 7fc672989640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c1e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc672989640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c155fc0 0x7fc66c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc672989640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66c1563a0 0x7fc66c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc672989640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c073470 con 0x7fc66c155fc0 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc672989640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0732f0 con 0x7fc66c1563a0 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc672989640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c0735f0 con 0x7fc66c06cfe0 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c1e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c155fc0 0x7fc66c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c1e2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:36306/0 (socket says 172.21.15.57:36306) 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 -- 172.21.15.57:0/1410223846 learned_addr learned my addr 172.21.15.57:0/1410223846 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:22.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc670f26640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66c1563a0 0x7fc66c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 -- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66c1563a0 msgr2=0x7fc66c15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66c1563a0 0x7fc66c15ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 -- 172.21.15.57:0/1410223846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c155fc0 msgr2=0x7fc66c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c155fc0 0x7fc66c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 -- 172.21.15.57:0/1410223846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c143b30 con 0x7fc66c06cfe0 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc670f26640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66c1563a0 0x7fc66c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:22.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66b7fe640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c155fc0 0x7fc66c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:22.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.375+0000 7fc66bfff640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c1e2a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00c490 tx=0x7fc65c00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.376+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c016020 con 0x7fc66c06cfe0 2024-09-10T11:43:22.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.376+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc65c012940 con 0x7fc66c06cfe0 2024-09-10T11:43:22.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.376+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c0c7c40 con 0x7fc66c06cfe0 2024-09-10T11:43:22.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.376+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c012d90 con 0x7fc66c06cfe0 2024-09-10T11:43:22.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.376+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c143dd0 con 0x7fc66c06cfe0 2024-09-10T11:43:22.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.377+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c076130 con 0x7fc66c06cfe0 2024-09-10T11:43:22.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.378+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fc65c019020 con 0x7fc66c06cfe0 2024-09-10T11:43:22.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.379+0000 7fc668ff9640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc6580750a0 0x7fc658077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:22.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.379+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fc65c095d20 con 0x7fc66c06cfe0 2024-09-10T11:43:22.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.379+0000 7fc66b7fe640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc6580750a0 0x7fc658077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:22.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.379+0000 7fc66b7fe640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc6580750a0 0x7fc658077560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc66c1f7d30 tx=0x7fc660005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:22.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.385+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fc65c020070 con 0x7fc66c06cfe0 2024-09-10T11:43:22.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.724+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc66c073aa0 con 0x7fc66c06cfe0 2024-09-10T11:43:22.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.725+0000 7fc668ff9640 1 -- 172.21.15.57:0/1410223846 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fc65c05f910 con 0x7fc66c06cfe0 2024-09-10T11:43:22.726 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:22.726 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:22.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc6580750a0 msgr2=0x7fc658077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc6580750a0 0x7fc658077560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc66c1f7d30 tx=0x7fc660005f90 comp rx=0 tx=0).stop 2024-09-10T11:43:22.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 msgr2=0x7fc66c1e2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:22.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c1e2a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00c490 tx=0x7fc65c00c950 comp rx=0 tx=0).stop 2024-09-10T11:43:22.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 shutdown_connections 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fc6580750a0 0x7fc658077560 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66c1563a0 0x7fc66c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc66c155fc0 0x7fc66c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 --2- 172.21.15.57:0/1410223846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc66c06cfe0 0x7fc66c1e2a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 >> 172.21.15.57:0/1410223846 conn(0x7fc66c0d09d0 msgr2=0x7fc66c0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 shutdown_connections 2024-09-10T11:43:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:22.727+0000 7fc672989640 1 -- 172.21.15.57:0/1410223846 wait complete. 2024-09-10T11:43:25.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 -- 172.21.15.57:0/1722330641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3410003be0 msgr2=0x7f3410004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 --2- 172.21.15.57:0/1722330641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3410003be0 0x7f3410004000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3418010b10 tx=0x7f3410005830 comp rx=0 tx=0).stop 2024-09-10T11:43:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 -- 172.21.15.57:0/1722330641 shutdown_connections 2024-09-10T11:43:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 --2- 172.21.15.57:0/1722330641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3410003be0 0x7f3410004000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 -- 172.21.15.57:0/1722330641 >> 172.21.15.57:0/1722330641 conn(0x7f34280d0a90 msgr2=0x7f34280d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 -- 172.21.15.57:0/1722330641 shutdown_connections 2024-09-10T11:43:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.870+0000 7f342d14c640 1 -- 172.21.15.57:0/1722330641 wait complete. 2024-09-10T11:43:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.871+0000 7f342d14c640 1 Processor -- start 2024-09-10T11:43:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.871+0000 7f342d14c640 1 -- start start 2024-09-10T11:43:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342d14c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3410003be0 0x7f3428154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342d14c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3428142440 0x7f34280b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342d14c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34280b0c90 0x7f34281521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342d14c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3428073740 con 0x7f34280b0c90 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342d14c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34280735c0 con 0x7f3428142440 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342d14c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f34280738c0 con 0x7f3410003be0 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f3426d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3410003be0 0x7f3428154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3428142440 0x7f34280b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f3426d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3410003be0 0x7f3428154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:36312/0 (socket says 172.21.15.57:36312) 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f3426d9d640 1 -- 172.21.15.57:0/1352798413 learned_addr learned my addr 172.21.15.57:0/1352798413 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.872+0000 7f342759e640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34280b0c90 0x7f34281521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342659c640 1 -- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3410003be0 msgr2=0x7f3428154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342659c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3410003be0 0x7f3428154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342659c640 1 -- 172.21.15.57:0/1352798413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34280b0c90 msgr2=0x7f34281521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342659c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34280b0c90 0x7f34281521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342659c640 1 -- 172.21.15.57:0/1352798413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3428152f50 con 0x7f3428142440 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342659c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3428142440 0x7f34280b0750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f342806ad30 tx=0x7f341c0039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c015070 con 0x7f3428142440 2024-09-10T11:43:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f341c011840 con 0x7f3428142440 2024-09-10T11:43:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3428153970 con 0x7f3428142440 2024-09-10T11:43:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3428153f30 con 0x7f3428142440 2024-09-10T11:43:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.873+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c011c90 con 0x7f3428142440 2024-09-10T11:43:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.874+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342815e660 con 0x7f3428142440 2024-09-10T11:43:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.875+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f341c018070 con 0x7f3428142440 2024-09-10T11:43:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.876+0000 7f340f7fe640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f34140750d0 0x7f3414077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.876+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f341c096ef0 con 0x7f3428142440 2024-09-10T11:43:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.876+0000 7f3426d9d640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f34140750d0 0x7f3414077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.876+0000 7f3426d9d640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f34140750d0 0x7f3414077590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3418000c00 tx=0x7f3418001360 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:25.881+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f341c060af0 con 0x7f3428142440 2024-09-10T11:43:26.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.164+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f34280cd280 con 0x7f3428142440 2024-09-10T11:43:26.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.165+0000 7f340f7fe640 1 -- 172.21.15.57:0/1352798413 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f341c0652b0 con 0x7f3428142440 2024-09-10T11:43:26.167 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:26.167 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f34140750d0 msgr2=0x7f3414077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f34140750d0 0x7f3414077590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3418000c00 tx=0x7f3418001360 comp rx=0 tx=0).stop 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3428142440 msgr2=0x7f34280b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3428142440 0x7f34280b0750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f342806ad30 tx=0x7f341c0039c0 comp rx=0 tx=0).stop 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 shutdown_connections 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f34140750d0 0x7f3414077590 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:26.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34280b0c90 0x7f34281521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:26.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3428142440 0x7f34280b0750 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:26.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 --2- 172.21.15.57:0/1352798413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3410003be0 0x7f3428154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:26.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 >> 172.21.15.57:0/1352798413 conn(0x7f34280d0a90 msgr2=0x7f342815a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:26.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 shutdown_connections 2024-09-10T11:43:26.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:26.167+0000 7f342d14c640 1 -- 172.21.15.57:0/1352798413 wait complete. 2024-09-10T11:43:29.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.306+0000 7fb3e2060640 1 -- 172.21.15.57:0/2991127379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0d2900 msgr2=0x7fb3dc0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.306+0000 7fb3e2060640 1 --2- 172.21.15.57:0/2991127379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0d2900 0x7fb3dc0ce820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00097b0 tx=0x7fb3d002a3d0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.306+0000 7fb3e2060640 1 -- 172.21.15.57:0/2991127379 shutdown_connections 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.306+0000 7fb3e2060640 1 --2- 172.21.15.57:0/2991127379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0d2900 0x7fb3dc0ce820 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.306+0000 7fb3e2060640 1 -- 172.21.15.57:0/2991127379 >> 172.21.15.57:0/2991127379 conn(0x7fb3dc09cf60 msgr2=0x7fb3dc0d3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.306+0000 7fb3e2060640 1 -- 172.21.15.57:0/2991127379 shutdown_connections 2024-09-10T11:43:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.307+0000 7fb3e2060640 1 -- 172.21.15.57:0/2991127379 wait complete. 2024-09-10T11:43:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.308+0000 7fb3e2060640 1 Processor -- start 2024-09-10T11:43:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 -- start start 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0b2cd0 0x7fb3dc0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3dc0d2900 0x7fb3dc155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 0x7fb3dc156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0cf800 con 0x7fb3dc15de20 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0cf680 con 0x7fb3dc0b2cd0 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.309+0000 7fb3e2060640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb3dc0cf980 con 0x7fb3dc0d2900 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0b2cd0 0x7fb3dc0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3dbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 0x7fb3dc156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:29.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3dc0d2900 0x7fb3dc155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0b2cd0 0x7fb3dc0b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:34182/0 (socket says 172.21.15.57:34182) 2024-09-10T11:43:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3dbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 0x7fb3dc156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56500/0 (socket says 172.21.15.57:56500) 2024-09-10T11:43:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3dbfff640 1 -- 172.21.15.57:0/1913059369 learned_addr learned my addr 172.21.15.57:0/1913059369 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 -- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0b2cd0 msgr2=0x7fb3dc0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0b2cd0 0x7fb3dc0b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 -- 172.21.15.57:0/1913059369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 msgr2=0x7fb3dc156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:29.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 0x7fb3dc156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 -- 172.21.15.57:0/1913059369 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc0cbe60 con 0x7fb3dc0d2900 2024-09-10T11:43:29.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3dbfff640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 0x7fb3dc156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:29.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3daffd640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3dc0d2900 0x7fb3dc155c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0031000 tx=0x7fb3d00305f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.310+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0041020 con 0x7fb3dc0d2900 2024-09-10T11:43:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.311+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3d0004020 con 0x7fb3dc0d2900 2024-09-10T11:43:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.311+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0037040 con 0x7fb3dc0d2900 2024-09-10T11:43:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.311+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc0cc100 con 0x7fb3dc0d2900 2024-09-10T11:43:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.311+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3dc0cc6c0 con 0x7fb3dc0d2900 2024-09-10T11:43:29.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.312+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3dc0b3610 con 0x7fb3dc0d2900 2024-09-10T11:43:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.312+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb3d0044070 con 0x7fb3dc0d2900 2024-09-10T11:43:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.313+0000 7fb3c3fff640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3c80750a0 0x7fb3c8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.313+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb3d00b59f0 con 0x7fb3dc0d2900 2024-09-10T11:43:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.313+0000 7fb3db7fe640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3c80750a0 0x7fb3c8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:29.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.314+0000 7fb3db7fe640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3c80750a0 0x7fb3c8077560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc001990 tx=0x7fb3cc009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:29.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.319+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb3d007f710 con 0x7fb3dc0d2900 2024-09-10T11:43:29.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.606+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3dc075e10 con 0x7fb3dc0d2900 2024-09-10T11:43:29.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.607+0000 7fb3c3fff640 1 -- 172.21.15.57:0/1913059369 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb3d0083ed0 con 0x7fb3dc0d2900 2024-09-10T11:43:29.609 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:29.609 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3c80750a0 msgr2=0x7fb3c8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3c80750a0 0x7fb3c8077560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc001990 tx=0x7fb3cc009040 comp rx=0 tx=0).stop 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3dc0d2900 msgr2=0x7fb3dc155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3dc0d2900 0x7fb3dc155c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0031000 tx=0x7fb3d00305f0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 shutdown_connections 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb3c80750a0 0x7fb3c8077560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3dc15de20 0x7fb3dc156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3dc0d2900 0x7fb3dc155c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 --2- 172.21.15.57:0/1913059369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3dc0b2cd0 0x7fb3dc0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:29.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 >> 172.21.15.57:0/1913059369 conn(0x7fb3dc09cf60 msgr2=0x7fb3dc15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:29.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 shutdown_connections 2024-09-10T11:43:29.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:29.609+0000 7fb3e2060640 1 -- 172.21.15.57:0/1913059369 wait complete. 2024-09-10T11:43:32.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:32.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 -- 172.21.15.57:0/3141556305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 msgr2=0x7fd6e40b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:32.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/3141556305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e40b58c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc005fd0 tx=0x7fd6dc02aa30 comp rx=0 tx=0).stop 2024-09-10T11:43:32.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 -- 172.21.15.57:0/3141556305 shutdown_connections 2024-09-10T11:43:32.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/3141556305 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e40b58c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 -- 172.21.15.57:0/3141556305 >> 172.21.15.57:0/3141556305 conn(0x7fd6e40d1ac0 msgr2=0x7fd6e40d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 -- 172.21.15.57:0/3141556305 shutdown_connections 2024-09-10T11:43:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.762+0000 7fd6ec71e640 1 -- 172.21.15.57:0/3141556305 wait complete. 2024-09-10T11:43:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.763+0000 7fd6ec71e640 1 Processor -- start 2024-09-10T11:43:32.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.764+0000 7fd6ec71e640 1 -- start start 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.764+0000 7fd6ec71e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e40cfe70 0x7fd6e40b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.764+0000 7fd6ec71e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e41f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.764+0000 7fd6ec71e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e415bbb0 0x7fd6e41f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.764+0000 7fd6ec71e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e40d28d0 con 0x7fd6e40d02d0 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.764+0000 7fd6ec71e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e40d2750 con 0x7fd6e415bbb0 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6ec71e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e40b5e00 con 0x7fd6e40cfe70 2024-09-10T11:43:32.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e41f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6ea4ba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e40cfe70 0x7fd6e40b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e41f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34350/0 (socket says 172.21.15.57:34350) 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 -- 172.21.15.57:0/1646147389 learned_addr learned my addr 172.21.15.57:0/1646147389 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6eacbb640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e415bbb0 0x7fd6e41f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 -- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e40cfe70 msgr2=0x7fd6e40b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e40cfe70 0x7fd6e40b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 -- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e415bbb0 msgr2=0x7fd6e41f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e415bbb0 0x7fd6e41f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 -- 172.21.15.57:0/1646147389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e41f7ee0 con 0x7fd6e40d02d0 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6ea4ba640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e40cfe70 0x7fd6e40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:32.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6eacbb640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e415bbb0 0x7fd6e41f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6e9cb9640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e41f4960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c410 tx=0x7fd6d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4017070 con 0x7fd6e40d02d0 2024-09-10T11:43:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6d40035f0 con 0x7fd6e40d02d0 2024-09-10T11:43:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.765+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e41f81c0 con 0x7fd6e40d02d0 2024-09-10T11:43:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.766+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4003a80 con 0x7fd6e40d02d0 2024-09-10T11:43:32.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.766+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e41f8780 con 0x7fd6e40d02d0 2024-09-10T11:43:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.767+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e40b6a70 con 0x7fd6e40d02d0 2024-09-10T11:43:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.768+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd6d401a070 con 0x7fd6e40d02d0 2024-09-10T11:43:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.768+0000 7fd6daffd640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6c80750f0 0x7fd6c80775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.768+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd6d4095520 con 0x7fd6e40d02d0 2024-09-10T11:43:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.769+0000 7fd6ea4ba640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6c80750f0 0x7fd6c80775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:32.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.769+0000 7fd6ea4ba640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6c80750f0 0x7fd6c80775b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0001ce0 tx=0x7fd6e0009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:32.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:32.773+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd6d405f320 con 0x7fd6e40d02d0 2024-09-10T11:43:33.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.115+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd6e4071d80 con 0x7fd6e40d02d0 2024-09-10T11:43:33.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.115+0000 7fd6daffd640 1 -- 172.21.15.57:0/1646147389 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd6d4063ae0 con 0x7fd6e40d02d0 2024-09-10T11:43:33.117 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:33.117 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:33.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6c80750f0 msgr2=0x7fd6c80775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:33.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6c80750f0 0x7fd6c80775b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0001ce0 tx=0x7fd6e0009040 comp rx=0 tx=0).stop 2024-09-10T11:43:33.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 msgr2=0x7fd6e41f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:33.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e41f4960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c410 tx=0x7fd6d400c8d0 comp rx=0 tx=0).stop 2024-09-10T11:43:33.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 shutdown_connections 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd6c80750f0 0x7fd6c80775b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e415bbb0 0x7fd6e41f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e40d02d0 0x7fd6e41f4960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 --2- 172.21.15.57:0/1646147389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e40cfe70 0x7fd6e40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 >> 172.21.15.57:0/1646147389 conn(0x7fd6e40d1ac0 msgr2=0x7fd6e415b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 shutdown_connections 2024-09-10T11:43:33.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:33.118+0000 7fd6ec71e640 1 -- 172.21.15.57:0/1646147389 wait complete. 2024-09-10T11:43:36.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:36.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 -- 172.21.15.57:0/3527196797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100d26c0 msgr2=0x7fb1100ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:36.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 --2- 172.21.15.57:0/3527196797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100d26c0 0x7fb1100ccce0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb104005fd0 tx=0x7fb10402a5f0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 -- 172.21.15.57:0/3527196797 shutdown_connections 2024-09-10T11:43:36.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 --2- 172.21.15.57:0/3527196797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100d26c0 0x7fb1100ccce0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 -- 172.21.15.57:0/3527196797 >> 172.21.15.57:0/3527196797 conn(0x7fb1100d1ac0 msgr2=0x7fb1100d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:36.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 -- 172.21.15.57:0/3527196797 shutdown_connections 2024-09-10T11:43:36.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.274+0000 7fb116907640 1 -- 172.21.15.57:0/3527196797 wait complete. 2024-09-10T11:43:36.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.276+0000 7fb116907640 1 Processor -- start 2024-09-10T11:43:36.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.276+0000 7fb116907640 1 -- start start 2024-09-10T11:43:36.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.277+0000 7fb116907640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100cd220 0x7fb1101580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.277+0000 7fb116907640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1100d26c0 0x7fb1101f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.277+0000 7fb116907640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb11015bcd0 0x7fb1101f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb116907640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100b5ae0 con 0x7fb1100cd220 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb116907640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100b5960 con 0x7fb1100d26c0 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1100d26c0 0x7fb1101f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100cd220 0x7fb1101580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1100d26c0 0x7fb1101f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:41228/0 (socket says 172.21.15.57:41228) 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10f7fe640 1 -- 172.21.15.57:0/1766232393 learned_addr learned my addr 172.21.15.57:0/1766232393 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb116907640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb1100b5c60 con 0x7fb11015bcd0 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb114ea4640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb11015bcd0 0x7fb1101f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 -- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb11015bcd0 msgr2=0x7fb1101f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:36.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb11015bcd0 0x7fb1101f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 -- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1100d26c0 msgr2=0x7fb1101f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1100d26c0 0x7fb1101f59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 -- 172.21.15.57:0/1766232393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1100c9db0 con 0x7fb1100cd220 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10ffff640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100cd220 0x7fb1101580a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c390 tx=0x7fb10000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.278+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100017070 con 0x7fb1100cd220 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.279+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1000035f0 con 0x7fb1100cd220 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.279+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1100ca090 con 0x7fb1100cd220 2024-09-10T11:43:36.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.279+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100003a40 con 0x7fb1100cd220 2024-09-10T11:43:36.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.279+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11015f220 con 0x7fb1100cd220 2024-09-10T11:43:36.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.281+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1100b6150 con 0x7fb1100cd220 2024-09-10T11:43:36.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.281+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fb10001a070 con 0x7fb1100cd220 2024-09-10T11:43:36.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.282+0000 7fb10cff9640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb0fc0750a0 0x7fb0fc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.282+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fb100095520 con 0x7fb1100cd220 2024-09-10T11:43:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.282+0000 7fb10f7fe640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb0fc0750a0 0x7fb0fc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:36.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.282+0000 7fb10f7fe640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb0fc0750a0 0x7fb0fc077560 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb104000c00 tx=0x7fb104004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:36.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.285+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fb10005f1b0 con 0x7fb1100cd220 2024-09-10T11:43:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.560+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb11015b2d0 con 0x7fb1100cd220 2024-09-10T11:43:36.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.561+0000 7fb10cff9640 1 -- 172.21.15.57:0/1766232393 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fb100063970 con 0x7fb1100cd220 2024-09-10T11:43:36.563 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:36.563 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.563+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb0fc0750a0 msgr2=0x7fb0fc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:36.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.563+0000 7fb116907640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb0fc0750a0 0x7fb0fc077560 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb104000c00 tx=0x7fb104004730 comp rx=0 tx=0).stop 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.563+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100cd220 msgr2=0x7fb1101580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.563+0000 7fb116907640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100cd220 0x7fb1101580a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c390 tx=0x7fb10000c850 comp rx=0 tx=0).stop 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.563+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 shutdown_connections 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fb0fc0750a0 0x7fb0fc077560 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb11015bcd0 0x7fb1101f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1100d26c0 0x7fb1101f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 --2- 172.21.15.57:0/1766232393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1100cd220 0x7fb1101580a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 >> 172.21.15.57:0/1766232393 conn(0x7fb1100d1ac0 msgr2=0x7fb110071680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 shutdown_connections 2024-09-10T11:43:36.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:36.564+0000 7fb116907640 1 -- 172.21.15.57:0/1766232393 wait complete. 2024-09-10T11:43:39.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1685604092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 msgr2=0x7fa4d40c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1685604092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40c72c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009830 tx=0x7fa4d002a4a0 comp rx=0 tx=0).stop 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1685604092 shutdown_connections 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1685604092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40c72c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1685604092 >> 172.21.15.57:0/1685604092 conn(0x7fa4d40b1da0 msgr2=0x7fa4d40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1685604092 shutdown_connections 2024-09-10T11:43:39.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.705+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1685604092 wait complete. 2024-09-10T11:43:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.706+0000 7fa4dc3f5640 1 Processor -- start 2024-09-10T11:43:39.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.706+0000 7fa4dc3f5640 1 -- start start 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4dc3f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4d40cc160 0x7fa4d40c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4dc3f5640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4dc3f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d415e9f0 0x7fa4d40b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4dc3f5640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d406d740 con 0x7fa4d415e1f0 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4dc3f5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d406d5c0 con 0x7fa4d415e9f0 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4dc3f5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d406e350 con 0x7fa4d40cc160 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41626/0 (socket says 172.21.15.57:41626) 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 -- 172.21.15.57:0/1063636846 learned_addr learned my addr 172.21.15.57:0/1063636846 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4da191640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4d40cc160 0x7fa4d40c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4da992640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d415e9f0 0x7fa4d40b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:39.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 -- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4d40cc160 msgr2=0x7fa4d40c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4d40cc160 0x7fa4d40c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 -- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d415e9f0 msgr2=0x7fa4d40b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d415e9f0 0x7fa4d40b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 -- 172.21.15.57:0/1063636846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40c6d00 con 0x7fa4d415e1f0 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.708+0000 7fa4d9990640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40b53c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c3a0 tx=0x7fa4c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.709+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011790 con 0x7fa4d415e1f0 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.709+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4c4017070 con 0x7fa4d415e1f0 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.709+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d415cc60 con 0x7fa4d415e1f0 2024-09-10T11:43:39.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.709+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011cc0 con 0x7fa4d415e1f0 2024-09-10T11:43:39.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.709+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d40c6500 con 0x7fa4d415e1f0 2024-09-10T11:43:39.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.710+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d415e5d0 con 0x7fa4d415e1f0 2024-09-10T11:43:39.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.711+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa4c401c460 con 0x7fa4d415e1f0 2024-09-10T11:43:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.712+0000 7fa4caffd640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa4b80750a0 0x7fa4b8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.712+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa4c4095f70 con 0x7fa4d415e1f0 2024-09-10T11:43:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.712+0000 7fa4da191640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa4b80750a0 0x7fa4b8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:39.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.713+0000 7fa4da191640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa4b80750a0 0x7fa4b8077560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0034000 tx=0x7fa4d0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:39.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:39.718+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fa4c405fc90 con 0x7fa4d415e1f0 2024-09-10T11:43:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.039+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4d415d650 con 0x7fa4d415e1f0 2024-09-10T11:43:40.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.040+0000 7fa4caffd640 1 -- 172.21.15.57:0/1063636846 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fa4c4064450 con 0x7fa4d415e1f0 2024-09-10T11:43:40.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:40.042 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa4b80750a0 msgr2=0x7fa4b8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa4b80750a0 0x7fa4b8077560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0034000 tx=0x7fa4d0004730 comp rx=0 tx=0).stop 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 msgr2=0x7fa4d40b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40b53c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c3a0 tx=0x7fa4c400c860 comp rx=0 tx=0).stop 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 shutdown_connections 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa4b80750a0 0x7fa4b8077560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d415e9f0 0x7fa4d40b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4d415e1f0 0x7fa4d40b53c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 --2- 172.21.15.57:0/1063636846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4d40cc160 0x7fa4d40c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.042+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 >> 172.21.15.57:0/1063636846 conn(0x7fa4d40b1da0 msgr2=0x7fa4d406fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.043+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 shutdown_connections 2024-09-10T11:43:40.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:40.043+0000 7fa4dc3f5640 1 -- 172.21.15.57:0/1063636846 wait complete. 2024-09-10T11:43:43.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:43.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 -- 172.21.15.57:0/3420686400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80731e0 msgr2=0x7fd2f80735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:43.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 --2- 172.21.15.57:0/3420686400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80731e0 0x7fd2f80735c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009830 tx=0x7fd2ec02a510 comp rx=0 tx=0).stop 2024-09-10T11:43:43.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 -- 172.21.15.57:0/3420686400 shutdown_connections 2024-09-10T11:43:43.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 --2- 172.21.15.57:0/3420686400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f8070050 0x7fd2f815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 --2- 172.21.15.57:0/3420686400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80731e0 0x7fd2f80735c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 -- 172.21.15.57:0/3420686400 >> 172.21.15.57:0/3420686400 conn(0x7fd2f80d0a90 msgr2=0x7fd2f80d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:43.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 -- 172.21.15.57:0/3420686400 shutdown_connections 2024-09-10T11:43:43.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.170+0000 7fd2feccd640 1 -- 172.21.15.57:0/3420686400 wait complete. 2024-09-10T11:43:43.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.172+0000 7fd2feccd640 1 Processor -- start 2024-09-10T11:43:43.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.172+0000 7fd2feccd640 1 -- start start 2024-09-10T11:43:43.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.173+0000 7fd2feccd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 0x7fd2f813ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:43.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.173+0000 7fd2feccd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f80731e0 0x7fd2f8150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:43.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.173+0000 7fd2feccd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80b3a00 0x7fd2f813f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:43.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2feccd640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f815f350 con 0x7fd2f8070050 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2feccd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f815f1d0 con 0x7fd2f80b3a00 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2feccd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f80b3e50 con 0x7fd2f80731e0 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fca69640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 0x7fd2f813ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fca69640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 0x7fd2f813ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41642/0 (socket says 172.21.15.57:41642) 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fca69640 1 -- 172.21.15.57:0/141923928 learned_addr learned my addr 172.21.15.57:0/141923928 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80b3a00 0x7fd2f813f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2f7fff640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f80731e0 0x7fd2f8150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 -- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f80731e0 msgr2=0x7fd2f8150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f80731e0 0x7fd2f8150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 -- 172.21.15.57:0/141923928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 msgr2=0x7fd2f813ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 0x7fd2f813ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 -- 172.21.15.57:0/141923928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f81569e0 con 0x7fd2f80b3a00 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fca69640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 0x7fd2f813ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2f7fff640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f80731e0 0x7fd2f8150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.174+0000 7fd2fd26a640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80b3a00 0x7fd2f813f4e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009fd0 tx=0x7fd2f000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.175+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000ce20 con 0x7fd2f80b3a00 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.175+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f0004c10 con 0x7fd2f80b3a00 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.175+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f8156cc0 con 0x7fd2f80b3a00 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.175+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0005020 con 0x7fd2f80b3a00 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.175+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f8157280 con 0x7fd2f80b3a00 2024-09-10T11:43:43.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.176+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f80735c0 con 0x7fd2f80b3a00 2024-09-10T11:43:43.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.177+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd2f00051c0 con 0x7fd2f80b3a00 2024-09-10T11:43:43.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.178+0000 7fd2f57fa640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd2dc0750a0 0x7fd2dc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:43.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.178+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd2f0097240 con 0x7fd2f80b3a00 2024-09-10T11:43:43.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.178+0000 7fd2fca69640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd2dc0750a0 0x7fd2dc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:43.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.179+0000 7fd2fca69640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd2dc0750a0 0x7fd2dc077560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0095f0 tx=0x7fd2ec004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:43.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.182+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd2f0061480 con 0x7fd2f80b3a00 2024-09-10T11:43:43.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.495+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd2f8073d10 con 0x7fd2f80b3a00 2024-09-10T11:43:43.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.495+0000 7fd2f57fa640 1 -- 172.21.15.57:0/141923928 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7fd2f0060d80 con 0x7fd2f80b3a00 2024-09-10T11:43:43.497 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:43.497 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd2dc0750a0 msgr2=0x7fd2dc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd2dc0750a0 0x7fd2dc077560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0095f0 tx=0x7fd2ec004730 comp rx=0 tx=0).stop 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80b3a00 msgr2=0x7fd2f813f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80b3a00 0x7fd2f813f4e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009fd0 tx=0x7fd2f000ef10 comp rx=0 tx=0).stop 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 shutdown_connections 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd2dc0750a0 0x7fd2dc077560 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f80b3a00 0x7fd2f813f4e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2f80731e0 0x7fd2f8150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 --2- 172.21.15.57:0/141923928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2f8070050 0x7fd2f813ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:43.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 >> 172.21.15.57:0/141923928 conn(0x7fd2f80d0a90 msgr2=0x7fd2f80cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:43.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 shutdown_connections 2024-09-10T11:43:43.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:43.498+0000 7fd2feccd640 1 -- 172.21.15.57:0/141923928 wait complete. 2024-09-10T11:43:46.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.646+0000 7f31d1c48640 1 -- 172.21.15.57:0/3647354895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 msgr2=0x7f31cc06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.646+0000 7f31d1c48640 1 --2- 172.21.15.57:0/3647354895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc06e0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009860 tx=0x7f31c002a510 comp rx=0 tx=0).stop 2024-09-10T11:43:46.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.647+0000 7f31d1c48640 1 -- 172.21.15.57:0/3647354895 shutdown_connections 2024-09-10T11:43:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.647+0000 7f31d1c48640 1 --2- 172.21.15.57:0/3647354895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc06e0f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.647+0000 7f31d1c48640 1 -- 172.21.15.57:0/3647354895 >> 172.21.15.57:0/3647354895 conn(0x7f31cc0d1aa0 msgr2=0x7f31cc0d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.647+0000 7f31d1c48640 1 -- 172.21.15.57:0/3647354895 shutdown_connections 2024-09-10T11:43:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.647+0000 7f31d1c48640 1 -- 172.21.15.57:0/3647354895 wait complete. 2024-09-10T11:43:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.648+0000 7f31d1c48640 1 Processor -- start 2024-09-10T11:43:46.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.648+0000 7f31d1c48640 1 -- start start 2024-09-10T11:43:46.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.649+0000 7f31d1c48640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 0x7f31cc09c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:46.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31d1c48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc15de90 0x7f31cc0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:46.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31d1c48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc1f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:46.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31d1c48640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc0b73b0 con 0x7f31cc0b52a0 2024-09-10T11:43:46.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31d1c48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc0b7230 con 0x7f31cc15de90 2024-09-10T11:43:46.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31d1c48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc0b7530 con 0x7f31cc15e270 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 0x7f31cc09c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 0x7f31cc09c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41658/0 (socket says 172.21.15.57:41658) 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 -- 172.21.15.57:0/88690879 learned_addr learned my addr 172.21.15.57:0/88690879 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cbfff640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc1f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31caffd640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc15de90 0x7f31cc0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 -- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 msgr2=0x7f31cc1f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc1f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 -- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc15de90 msgr2=0x7f31cc0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc15de90 0x7f31cc0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 -- 172.21.15.57:0/88690879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc1f5290 con 0x7f31cc0b52a0 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31caffd640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc15de90 0x7f31cc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cbfff640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc1f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:46.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.650+0000 7f31cb7fe640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 0x7f31cc09c1f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c730 tx=0x7f31bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:46.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.651+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc017070 con 0x7f31cc0b52a0 2024-09-10T11:43:46.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.651+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31bc005360 con 0x7f31cc0b52a0 2024-09-10T11:43:46.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.651+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00a8a0 con 0x7f31cc0b52a0 2024-09-10T11:43:46.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.651+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc1f5570 con 0x7f31cc0b52a0 2024-09-10T11:43:46.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.651+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc09c730 con 0x7f31cc0b52a0 2024-09-10T11:43:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.652+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc0b68d0 con 0x7f31cc0b52a0 2024-09-10T11:43:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.653+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f31bc01a070 con 0x7f31cc0b52a0 2024-09-10T11:43:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.653+0000 7f31b3fff640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.654+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f31bc0955f0 con 0x7f31cc0b52a0 2024-09-10T11:43:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.654+0000 7f31caffd640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:46.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.654+0000 7f31caffd640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f31c0034000 tx=0x7f31c0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:46.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.661+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f31bc05f310 con 0x7f31cc0b52a0 2024-09-10T11:43:46.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.992+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31cc0d2220 con 0x7f31cc0b52a0 2024-09-10T11:43:46.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.992+0000 7f31b3fff640 1 -- 172.21.15.57:0/88690879 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f31bc063ad0 con 0x7f31cc0b52a0 2024-09-10T11:43:46.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:46.995 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:46.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 msgr2=0x7f31b8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:46.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f31c0034000 tx=0x7f31c0004730 comp rx=0 tx=0).stop 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 msgr2=0x7f31cc09c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 0x7f31cc09c1f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c730 tx=0x7f31bc00cbf0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 shutdown_connections 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31b80750a0 0x7f31b8077560 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31cc15e270 0x7f31cc1f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31cc15de90 0x7f31cc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 --2- 172.21.15.57:0/88690879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31cc0b52a0 0x7f31cc09c1f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 >> 172.21.15.57:0/88690879 conn(0x7f31cc0d1aa0 msgr2=0x7f31cc070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 shutdown_connections 2024-09-10T11:43:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:46.995+0000 7f31d1c48640 1 -- 172.21.15.57:0/88690879 wait complete. 2024-09-10T11:43:50.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T11:43:50.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 -- 172.21.15.57:0/3928521384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 msgr2=0x7f67e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 --2- 172.21.15.57:0/3928521384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67e8003de0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009d00 tx=0x7f67e8005830 comp rx=0 tx=0).stop 2024-09-10T11:43:50.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 -- 172.21.15.57:0/3928521384 shutdown_connections 2024-09-10T11:43:50.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 --2- 172.21.15.57:0/3928521384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67e8003de0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 -- 172.21.15.57:0/3928521384 >> 172.21.15.57:0/3928521384 conn(0x7f67fc068c70 msgr2=0x7f67fc06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:50.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 -- 172.21.15.57:0/3928521384 shutdown_connections 2024-09-10T11:43:50.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.136+0000 7f6804447640 1 -- 172.21.15.57:0/3928521384 wait complete. 2024-09-10T11:43:50.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.138+0000 7f6804447640 1 Processor -- start 2024-09-10T11:43:50.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.138+0000 7f6804447640 1 -- start start 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f6804447640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67fc162450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f6804447640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc1f3300 0x7f67fc1f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f6804447640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67fc1f5ba0 0x7f67fc1647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f6804447640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0b49a0 con 0x7f67e8003a00 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f6804447640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0b4820 con 0x7f67fc1f5ba0 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f6804447640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc0cf630 con 0x7f67fc1f3300 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67fc162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67fc162450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38828/0 (socket says 172.21.15.57:38828) 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68019e2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc1f3300 0x7f67fc1f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 -- 172.21.15.57:0/2329969440 learned_addr learned my addr 172.21.15.57:0/2329969440 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68029e4640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67fc1f5ba0 0x7f67fc1647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 -- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc1f3300 msgr2=0x7f67fc1f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc1f3300 0x7f67fc1f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 -- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67fc1f5ba0 msgr2=0x7f67fc1647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67fc1f5ba0 0x7f67fc1647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 -- 172.21.15.57:0/2329969440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc162990 con 0x7f67e8003a00 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.139+0000 7f68021e3640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67fc162450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009e20 tx=0x7f67f8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.140+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8038040 con 0x7f67e8003a00 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.140+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc1f60e0 con 0x7f67e8003a00 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.140+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67f802b9f0 con 0x7f67e8003a00 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.140+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc163110 con 0x7f67e8003a00 2024-09-10T11:43:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.140+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8003c10 con 0x7f67e8003a00 2024-09-10T11:43:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.141+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67fc16d480 con 0x7f67e8003a00 2024-09-10T11:43:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.142+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f67f8043020 con 0x7f67e8003a00 2024-09-10T11:43:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.142+0000 7f67f2ffd640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f67e00750d0 0x7f67e0077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.142+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f67f80b68f0 con 0x7f67e8003a00 2024-09-10T11:43:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.142+0000 7f68019e2640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f67e00750d0 0x7f67e0077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.143+0000 7f68019e2640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f67e00750d0 0x7f67e0077590 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f67ec006fd0 tx=0x7f67ec006c70 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:50.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.148+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f67fc16d480 con 0x7f67e8003a00 2024-09-10T11:43:50.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.459+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f67fc16bb00 con 0x7f67e8003a00 2024-09-10T11:43:50.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.460+0000 7f67f2ffd640 1 -- 172.21.15.57:0/2329969440 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (secure 0 0 0) 0x7f67f8080590 con 0x7f67e8003a00 2024-09-10T11:43:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:50.462 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-10T11:43:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f67e00750d0 msgr2=0x7f67e0077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f67e00750d0 0x7f67e0077590 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f67ec006fd0 tx=0x7f67ec006c70 comp rx=0 tx=0).stop 2024-09-10T11:43:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 msgr2=0x7f67fc162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67fc162450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009e20 tx=0x7f67f8003820 comp rx=0 tx=0).stop 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 shutdown_connections 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f67e00750d0 0x7f67e0077590 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67fc1f5ba0 0x7f67fc1647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67fc1f3300 0x7f67fc1f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 --2- 172.21.15.57:0/2329969440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67e8003a00 0x7f67fc162450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 >> 172.21.15.57:0/2329969440 conn(0x7f67fc068c70 msgr2=0x7f67fc16d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 shutdown_connections 2024-09-10T11:43:50.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.462+0000 7f6804447640 1 -- 172.21.15.57:0/2329969440 wait complete. 2024-09-10T11:43:50.475 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T11:43:50.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.606+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3252202982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4815b6c0 msgr2=0x7fdb4806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.606+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3252202982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4815b6c0 0x7fdb4806c9b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009830 tx=0x7fdb3802a480 comp rx=0 tx=0).stop 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.606+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3252202982 shutdown_connections 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.606+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3252202982 >> v2:172.21.15.154:3300/0 conn(0x7fdb480ccef0 0x7fdb48071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.606+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3252202982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4815b6c0 0x7fdb4806c9b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.606+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3252202982 >> 172.21.15.57:0/3252202982 conn(0x7fdb480d0a60 msgr2=0x7fdb480d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.607+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3252202982 shutdown_connections 2024-09-10T11:43:50.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.607+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3252202982 wait complete. 2024-09-10T11:43:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.608+0000 7fdb4cf56640 1 Processor -- start 2024-09-10T11:43:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.608+0000 7fdb4cf56640 1 -- start start 2024-09-10T11:43:50.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4cf56640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 0x7fdb481f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4cf56640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 0x7fdb480cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4cf56640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 0x7fdb480b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 0x7fdb481f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 0x7fdb481f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:54254/0 (socket says 172.21.15.57:54254) 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 0x7fdb480cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 0x7fdb480cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58726/0 (socket says 172.21.15.57:58726) 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb46d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 0x7fdb480b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb46d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 0x7fdb480b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38842/0 (socket says 172.21.15.57:38842) 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4cf56640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4815baa0 con 0x7fdb4815b6c0 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4659c640 1 -- 172.21.15.57:0/3649611750 learned_addr learned my addr 172.21.15.57:0/3649611750 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb480719f0 con 0x7fdb480ccef0 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.609+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4815bc20 con 0x7fdb4806cef0 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4659c640 1 -- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 msgr2=0x7fdb480cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4659c640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 0x7fdb480cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4659c640 1 -- 172.21.15.57:0/3649611750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 msgr2=0x7fdb480b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4659c640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 0x7fdb480b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4659c640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb481f4410 con 0x7fdb4806cef0 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb3ffff640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 0x7fdb480cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb46d9d640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 0x7fdb480b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4659c640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 0x7fdb481f3ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009950 tx=0x7fdb38033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38005c90 con 0x7fdb4806cef0 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb38031e50 con 0x7fdb4806cef0 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380332f0 con 0x7fdb4806cef0 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb481f46a0 con 0x7fdb4806cef0 2024-09-10T11:43:50.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.610+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb481f4c60 con 0x7fdb4806cef0 2024-09-10T11:43:50.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.611+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb48071060 con 0x7fdb4806cef0 2024-09-10T11:43:50.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.612+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fdb38033490 con 0x7fdb4806cef0 2024-09-10T11:43:50.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.612+0000 7fdb3effd640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdb280750a0 0x7fdb28077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:50.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.613+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fdb380b7480 con 0x7fdb4806cef0 2024-09-10T11:43:50.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.613+0000 7fdb3ffff640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdb280750a0 0x7fdb28077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:50.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.613+0000 7fdb3ffff640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdb280750a0 0x7fdb28077560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdb30007f20 tx=0x7fdb30007eb0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:50.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.618+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fdb3803f030 con 0x7fdb4806cef0 2024-09-10T11:43:50.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.838+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb480b01c0 con 0x7fdb280750a0 2024-09-10T11:43:50.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.843+0000 7fdb3effd640 1 -- 172.21.15.57:0/3649611750 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251818 (secure 0 0 0) 0x7fdb480b01c0 con 0x7fdb280750a0 2024-09-10T11:43:50.848 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:50.850 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:43:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdb280750a0 msgr2=0x7fdb28077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdb280750a0 0x7fdb28077560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdb30007f20 tx=0x7fdb30007eb0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 msgr2=0x7fdb481f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 0x7fdb481f3ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009950 tx=0x7fdb38033c20 comp rx=0 tx=0).stop 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 shutdown_connections 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fdb280750a0 0x7fdb28077560 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb4815b6c0 0x7fdb480b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb480ccef0 0x7fdb480cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 --2- 172.21.15.57:0/3649611750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb4806cef0 0x7fdb481f3ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 >> 172.21.15.57:0/3649611750 conn(0x7fdb480d0a60 msgr2=0x7fdb480737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 shutdown_connections 2024-09-10T11:43:50.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:50.848+0000 7fdb4cf56640 1 -- 172.21.15.57:0/3649611750 wait complete. 2024-09-10T11:43:50.863 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T11:43:50.250572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235988,"kb_used_data":3112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738732,"statfs":{"total":773094113280,"available":772852461568,"internally_reserved":0,"allocated":3186688,"data_stored":1887852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.621023+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:40:44.621023+0000","last_peered":"2024-09-10T11:40:44.621023+0000","last_clean":"2024-09-10T11:40:44.621023+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:40:44.621023+0000","last_undegraded":"2024-09-10T11:40:44.621023+0000","last_fullsized":"2024-09-10T11:40:44.621023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625716+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:40:44.625716+0000","last_peered":"2024-09-10T11:40:44.625716+0000","last_clean":"2024-09-10T11:40:44.625716+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:40:44.625716+0000","last_undegraded":"2024-09-10T11:40:44.625716+0000","last_fullsized":"2024-09-10T11:40:44.625716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626827+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:40:44.626827+0000","last_peered":"2024-09-10T11:40:44.626827+0000","last_clean":"2024-09-10T11:40:44.626827+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:40:44.626827+0000","last_undegraded":"2024-09-10T11:40:44.626827+0000","last_fullsized":"2024-09-10T11:40:44.626827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622727+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:40:39.622727+0000","last_peered":"2024-09-10T11:40:39.622727+0000","last_clean":"2024-09-10T11:40:39.622727+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:40:39.622727+0000","last_undegraded":"2024-09-10T11:40:39.622727+0000","last_fullsized":"2024-09-10T11:40:39.622727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623143+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:41:09.623143+0000","last_peered":"2024-09-10T11:41:09.623143+0000","last_clean":"2024-09-10T11:41:09.623143+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:41:09.623143+0000","last_undegraded":"2024-09-10T11:41:09.623143+0000","last_fullsized":"2024-09-10T11:41:09.623143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625526+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:41:09.625526+0000","last_peered":"2024-09-10T11:41:09.625526+0000","last_clean":"2024-09-10T11:41:09.625526+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:41:09.625526+0000","last_undegraded":"2024-09-10T11:41:09.625526+0000","last_fullsized":"2024-09-10T11:41:09.625526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623125+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:41:09.623125+0000","last_peered":"2024-09-10T11:41:09.623125+0000","last_clean":"2024-09-10T11:41:09.623125+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:41:09.623125+0000","last_undegraded":"2024-09-10T11:41:09.623125+0000","last_fullsized":"2024-09-10T11:41:09.623125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625143+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:41:09.625143+0000","last_peered":"2024-09-10T11:41:09.625143+0000","last_clean":"2024-09-10T11:41:09.625143+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:41:09.625143+0000","last_undegraded":"2024-09-10T11:41:09.625143+0000","last_fullsized":"2024-09-10T11:41:09.625143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622777+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:41:04.622777+0000","last_peered":"2024-09-10T11:41:04.622777+0000","last_clean":"2024-09-10T11:41:04.622777+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:41:04.622777+0000","last_undegraded":"2024-09-10T11:41:04.622777+0000","last_fullsized":"2024-09-10T11:41:04.622777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630356+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:41:04.630356+0000","last_peered":"2024-09-10T11:41:04.630356+0000","last_clean":"2024-09-10T11:41:04.630356+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:41:04.630356+0000","last_undegraded":"2024-09-10T11:41:04.630356+0000","last_fullsized":"2024-09-10T11:41:04.630356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630342+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:41:04.630342+0000","last_peered":"2024-09-10T11:41:04.630342+0000","last_clean":"2024-09-10T11:41:04.630342+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:41:04.630342+0000","last_undegraded":"2024-09-10T11:41:04.630342+0000","last_fullsized":"2024-09-10T11:41:04.630342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.621969+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:41:04.621969+0000","last_peered":"2024-09-10T11:41:04.621969+0000","last_clean":"2024-09-10T11:41:04.621969+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:41:04.621969+0000","last_undegraded":"2024-09-10T11:41:04.621969+0000","last_fullsized":"2024-09-10T11:41:04.621969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:39:19.616974+0000","last_change":"2024-09-10T11:39:17.817004+0000","last_active":"2024-09-10T11:39:19.616974+0000","last_peered":"2024-09-10T11:39:19.616974+0000","last_clean":"2024-09-10T11:39:19.616974+0000","last_became_active":"2024-09-10T11:39:17.816727+0000","last_became_peered":"2024-09-10T11:39:17.816727+0000","last_unstale":"2024-09-10T11:39:19.616974+0000","last_undegraded":"2024-09-10T11:39:19.616974+0000","last_fullsized":"2024-09-10T11:39:19.616974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628297+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:40:59.628297+0000","last_peered":"2024-09-10T11:40:59.628297+0000","last_clean":"2024-09-10T11:40:59.628297+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:40:59.628297+0000","last_undegraded":"2024-09-10T11:40:59.628297+0000","last_fullsized":"2024-09-10T11:40:59.628297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.626910+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:40:59.626910+0000","last_peered":"2024-09-10T11:40:59.626910+0000","last_clean":"2024-09-10T11:40:59.626910+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:40:59.626910+0000","last_undegraded":"2024-09-10T11:40:59.626910+0000","last_fullsized":"2024-09-10T11:40:59.626910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624584+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:40:59.624584+0000","last_peered":"2024-09-10T11:40:59.624584+0000","last_clean":"2024-09-10T11:40:59.624584+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:40:59.624584+0000","last_undegraded":"2024-09-10T11:40:59.624584+0000","last_fullsized":"2024-09-10T11:40:59.624584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624632+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:40:59.624632+0000","last_peered":"2024-09-10T11:40:59.624632+0000","last_clean":"2024-09-10T11:40:59.624632+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:40:59.624632+0000","last_undegraded":"2024-09-10T11:40:59.624632+0000","last_fullsized":"2024-09-10T11:40:59.624632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625550+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:40:59.625550+0000","last_peered":"2024-09-10T11:40:59.625550+0000","last_clean":"2024-09-10T11:40:59.625550+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:40:59.625550+0000","last_undegraded":"2024-09-10T11:40:59.625550+0000","last_fullsized":"2024-09-10T11:40:59.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621920+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:40:54.621920+0000","last_peered":"2024-09-10T11:40:54.621920+0000","last_clean":"2024-09-10T11:40:54.621920+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:40:54.621920+0000","last_undegraded":"2024-09-10T11:40:54.621920+0000","last_fullsized":"2024-09-10T11:40:54.621920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629284+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:40:54.629284+0000","last_peered":"2024-09-10T11:40:54.629284+0000","last_clean":"2024-09-10T11:40:54.629284+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:40:54.629284+0000","last_undegraded":"2024-09-10T11:40:54.629284+0000","last_fullsized":"2024-09-10T11:40:54.629284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629142+0000","last_change":"2024-09-10T11:39:17.816383+0000","last_active":"2024-09-10T11:41:34.629142+0000","last_peered":"2024-09-10T11:41:34.629142+0000","last_clean":"2024-09-10T11:41:34.629142+0000","last_became_active":"2024-09-10T11:39:17.816084+0000","last_became_peered":"2024-09-10T11:39:17.816084+0000","last_unstale":"2024-09-10T11:41:34.629142+0000","last_undegraded":"2024-09-10T11:41:34.629142+0000","last_fullsized":"2024-09-10T11:41:34.629142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629050+0000","last_change":"2024-09-10T11:39:17.814534+0000","last_active":"2024-09-10T11:41:34.629050+0000","last_peered":"2024-09-10T11:41:34.629050+0000","last_clean":"2024-09-10T11:41:34.629050+0000","last_became_active":"2024-09-10T11:39:17.814205+0000","last_became_peered":"2024-09-10T11:39:17.814205+0000","last_unstale":"2024-09-10T11:41:34.629050+0000","last_undegraded":"2024-09-10T11:41:34.629050+0000","last_fullsized":"2024-09-10T11:41:34.629050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623787+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:40:54.623787+0000","last_peered":"2024-09-10T11:40:54.623787+0000","last_clean":"2024-09-10T11:40:54.623787+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:40:54.623787+0000","last_undegraded":"2024-09-10T11:40:54.623787+0000","last_fullsized":"2024-09-10T11:40:54.623787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623688+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:40:49.623688+0000","last_peered":"2024-09-10T11:40:49.623688+0000","last_clean":"2024-09-10T11:40:49.623688+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:40:49.623688+0000","last_undegraded":"2024-09-10T11:40:49.623688+0000","last_fullsized":"2024-09-10T11:40:49.623688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623386+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:40:49.623386+0000","last_peered":"2024-09-10T11:40:49.623386+0000","last_clean":"2024-09-10T11:40:49.623386+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:40:49.623386+0000","last_undegraded":"2024-09-10T11:40:49.623386+0000","last_fullsized":"2024-09-10T11:40:49.623386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628912+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:40:49.628912+0000","last_peered":"2024-09-10T11:40:49.628912+0000","last_clean":"2024-09-10T11:40:49.628912+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:40:49.628912+0000","last_undegraded":"2024-09-10T11:40:49.628912+0000","last_fullsized":"2024-09-10T11:40:49.628912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626088+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:40:49.626088+0000","last_peered":"2024-09-10T11:40:49.626088+0000","last_clean":"2024-09-10T11:40:49.626088+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:40:49.626088+0000","last_undegraded":"2024-09-10T11:40:49.626088+0000","last_fullsized":"2024-09-10T11:40:49.626088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623363+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:40:49.623363+0000","last_peered":"2024-09-10T11:40:49.623363+0000","last_clean":"2024-09-10T11:40:49.623363+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:40:49.623363+0000","last_undegraded":"2024-09-10T11:40:49.623363+0000","last_fullsized":"2024-09-10T11:40:49.623363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626811+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:40:44.626811+0000","last_peered":"2024-09-10T11:40:44.626811+0000","last_clean":"2024-09-10T11:40:44.626811+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:40:44.626811+0000","last_undegraded":"2024-09-10T11:40:44.626811+0000","last_fullsized":"2024-09-10T11:40:44.626811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623181+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:40:44.623181+0000","last_peered":"2024-09-10T11:40:44.623181+0000","last_clean":"2024-09-10T11:40:44.623181+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:40:44.623181+0000","last_undegraded":"2024-09-10T11:40:44.623181+0000","last_fullsized":"2024-09-10T11:40:44.623181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624234+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:40:44.624234+0000","last_peered":"2024-09-10T11:40:44.624234+0000","last_clean":"2024-09-10T11:40:44.624234+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:40:44.624234+0000","last_undegraded":"2024-09-10T11:40:44.624234+0000","last_fullsized":"2024-09-10T11:40:44.624234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628530+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:40:44.628530+0000","last_peered":"2024-09-10T11:40:44.628530+0000","last_clean":"2024-09-10T11:40:44.628530+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:40:44.628530+0000","last_undegraded":"2024-09-10T11:40:44.628530+0000","last_fullsized":"2024-09-10T11:40:44.628530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.622330+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:41:09.622330+0000","last_peered":"2024-09-10T11:41:09.622330+0000","last_clean":"2024-09-10T11:41:09.622330+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:41:09.622330+0000","last_undegraded":"2024-09-10T11:41:09.622330+0000","last_fullsized":"2024-09-10T11:41:09.622330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625179+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:41:09.625179+0000","last_peered":"2024-09-10T11:41:09.625179+0000","last_clean":"2024-09-10T11:41:09.625179+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:41:09.625179+0000","last_undegraded":"2024-09-10T11:41:09.625179+0000","last_fullsized":"2024-09-10T11:41:09.625179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.629118+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:41:09.629118+0000","last_peered":"2024-09-10T11:41:09.629118+0000","last_clean":"2024-09-10T11:41:09.629118+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:41:09.629118+0000","last_undegraded":"2024-09-10T11:41:09.629118+0000","last_fullsized":"2024-09-10T11:41:09.629118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630315+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:41:04.630315+0000","last_peered":"2024-09-10T11:41:04.630315+0000","last_clean":"2024-09-10T11:41:04.630315+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:41:04.630315+0000","last_undegraded":"2024-09-10T11:41:04.630315+0000","last_fullsized":"2024-09-10T11:41:04.630315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624745+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:41:04.624745+0000","last_peered":"2024-09-10T11:41:04.624745+0000","last_clean":"2024-09-10T11:41:04.624745+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:41:04.624745+0000","last_undegraded":"2024-09-10T11:41:04.624745+0000","last_fullsized":"2024-09-10T11:41:04.624745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624715+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:41:04.624715+0000","last_peered":"2024-09-10T11:41:04.624715+0000","last_clean":"2024-09-10T11:41:04.624715+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:41:04.624715+0000","last_undegraded":"2024-09-10T11:41:04.624715+0000","last_fullsized":"2024-09-10T11:41:04.624715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625081+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:41:04.625081+0000","last_peered":"2024-09-10T11:41:04.625081+0000","last_clean":"2024-09-10T11:41:04.625081+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:41:04.625081+0000","last_undegraded":"2024-09-10T11:41:04.625081+0000","last_fullsized":"2024-09-10T11:41:04.625081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627391+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:41:04.627391+0000","last_peered":"2024-09-10T11:41:04.627391+0000","last_clean":"2024-09-10T11:41:04.627391+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:41:04.627391+0000","last_undegraded":"2024-09-10T11:41:04.627391+0000","last_fullsized":"2024-09-10T11:41:04.627391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629889+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:40:59.629889+0000","last_peered":"2024-09-10T11:40:59.629889+0000","last_clean":"2024-09-10T11:40:59.629889+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:40:59.629889+0000","last_undegraded":"2024-09-10T11:40:59.629889+0000","last_fullsized":"2024-09-10T11:40:59.629889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625128+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:41:04.625128+0000","last_peered":"2024-09-10T11:41:04.625128+0000","last_clean":"2024-09-10T11:41:04.625128+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:41:04.625128+0000","last_undegraded":"2024-09-10T11:41:04.625128+0000","last_fullsized":"2024-09-10T11:41:04.625128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625143+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:41:04.625143+0000","last_peered":"2024-09-10T11:41:04.625143+0000","last_clean":"2024-09-10T11:41:04.625143+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:41:04.625143+0000","last_undegraded":"2024-09-10T11:41:04.625143+0000","last_fullsized":"2024-09-10T11:41:04.625143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.628725+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:41:04.628725+0000","last_peered":"2024-09-10T11:41:04.628725+0000","last_clean":"2024-09-10T11:41:04.628725+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:41:04.628725+0000","last_undegraded":"2024-09-10T11:41:04.628725+0000","last_fullsized":"2024-09-10T11:41:04.628725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627434+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:41:04.627434+0000","last_peered":"2024-09-10T11:41:04.627434+0000","last_clean":"2024-09-10T11:41:04.627434+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:41:04.627434+0000","last_undegraded":"2024-09-10T11:41:04.627434+0000","last_fullsized":"2024-09-10T11:41:04.627434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.621604+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:40:59.621604+0000","last_peered":"2024-09-10T11:40:59.621604+0000","last_clean":"2024-09-10T11:40:59.621604+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:40:59.621604+0000","last_undegraded":"2024-09-10T11:40:59.621604+0000","last_fullsized":"2024-09-10T11:40:59.621604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629292+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:40:54.629292+0000","last_peered":"2024-09-10T11:40:54.629292+0000","last_clean":"2024-09-10T11:40:54.629292+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:40:54.629292+0000","last_undegraded":"2024-09-10T11:40:54.629292+0000","last_fullsized":"2024-09-10T11:40:54.629292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622743+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:41:04.622743+0000","last_peered":"2024-09-10T11:41:04.622743+0000","last_clean":"2024-09-10T11:41:04.622743+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:41:04.622743+0000","last_undegraded":"2024-09-10T11:41:04.622743+0000","last_fullsized":"2024-09-10T11:41:04.622743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628332+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:40:59.628332+0000","last_peered":"2024-09-10T11:40:59.628332+0000","last_clean":"2024-09-10T11:40:59.628332+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:40:59.628332+0000","last_undegraded":"2024-09-10T11:40:59.628332+0000","last_fullsized":"2024-09-10T11:40:59.628332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628319+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:40:59.628319+0000","last_peered":"2024-09-10T11:40:59.628319+0000","last_clean":"2024-09-10T11:40:59.628319+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:40:59.628319+0000","last_undegraded":"2024-09-10T11:40:59.628319+0000","last_fullsized":"2024-09-10T11:40:59.628319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624605+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:40:59.624605+0000","last_peered":"2024-09-10T11:40:59.624605+0000","last_clean":"2024-09-10T11:40:59.624605+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:40:59.624605+0000","last_undegraded":"2024-09-10T11:40:59.624605+0000","last_fullsized":"2024-09-10T11:40:59.624605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622311+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:40:59.622311+0000","last_peered":"2024-09-10T11:40:59.622311+0000","last_clean":"2024-09-10T11:40:59.622311+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:40:59.622311+0000","last_undegraded":"2024-09-10T11:40:59.622311+0000","last_fullsized":"2024-09-10T11:40:59.622311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629268+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:40:54.629268+0000","last_peered":"2024-09-10T11:40:54.629268+0000","last_clean":"2024-09-10T11:40:54.629268+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:40:54.629268+0000","last_undegraded":"2024-09-10T11:40:54.629268+0000","last_fullsized":"2024-09-10T11:40:54.629268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629850+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:40:59.629850+0000","last_peered":"2024-09-10T11:40:59.629850+0000","last_clean":"2024-09-10T11:40:59.629850+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:40:59.629850+0000","last_undegraded":"2024-09-10T11:40:59.629850+0000","last_fullsized":"2024-09-10T11:40:59.629850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625504+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:40:59.625504+0000","last_peered":"2024-09-10T11:40:59.625504+0000","last_clean":"2024-09-10T11:40:59.625504+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:40:59.625504+0000","last_undegraded":"2024-09-10T11:40:59.625504+0000","last_fullsized":"2024-09-10T11:40:59.625504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622290+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:40:59.622290+0000","last_peered":"2024-09-10T11:40:59.622290+0000","last_clean":"2024-09-10T11:40:59.622290+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:40:59.622290+0000","last_undegraded":"2024-09-10T11:40:59.622290+0000","last_fullsized":"2024-09-10T11:40:59.622290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621204+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:40:54.621204+0000","last_peered":"2024-09-10T11:40:54.621204+0000","last_clean":"2024-09-10T11:40:54.621204+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:40:54.621204+0000","last_undegraded":"2024-09-10T11:40:54.621204+0000","last_fullsized":"2024-09-10T11:40:54.621204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621928+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:40:54.621928+0000","last_peered":"2024-09-10T11:40:54.621928+0000","last_clean":"2024-09-10T11:40:54.621928+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:40:54.621928+0000","last_undegraded":"2024-09-10T11:40:54.621928+0000","last_fullsized":"2024-09-10T11:40:54.621928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625183+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:40:54.625183+0000","last_peered":"2024-09-10T11:40:54.625183+0000","last_clean":"2024-09-10T11:40:54.625183+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:40:54.625183+0000","last_undegraded":"2024-09-10T11:40:54.625183+0000","last_fullsized":"2024-09-10T11:40:54.625183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621937+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:40:54.621937+0000","last_peered":"2024-09-10T11:40:54.621937+0000","last_clean":"2024-09-10T11:40:54.621937+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:40:54.621937+0000","last_undegraded":"2024-09-10T11:40:54.621937+0000","last_fullsized":"2024-09-10T11:40:54.621937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.626566+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:40:54.626566+0000","last_peered":"2024-09-10T11:40:54.626566+0000","last_clean":"2024-09-10T11:40:54.626566+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:40:54.626566+0000","last_undegraded":"2024-09-10T11:40:54.626566+0000","last_fullsized":"2024-09-10T11:40:54.626566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.624181+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:40:54.624181+0000","last_peered":"2024-09-10T11:40:54.624181+0000","last_clean":"2024-09-10T11:40:54.624181+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:40:54.624181+0000","last_undegraded":"2024-09-10T11:40:54.624181+0000","last_fullsized":"2024-09-10T11:40:54.624181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625163+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:40:54.625163+0000","last_peered":"2024-09-10T11:40:54.625163+0000","last_clean":"2024-09-10T11:40:54.625163+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:40:54.625163+0000","last_undegraded":"2024-09-10T11:40:54.625163+0000","last_fullsized":"2024-09-10T11:40:54.625163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621911+0000","last_change":"2024-09-10T11:39:18.205415+0000","last_active":"2024-09-10T11:40:54.621911+0000","last_peered":"2024-09-10T11:40:54.621911+0000","last_clean":"2024-09-10T11:40:54.621911+0000","last_became_active":"2024-09-10T11:39:18.205081+0000","last_became_peered":"2024-09-10T11:39:18.205081+0000","last_unstale":"2024-09-10T11:40:54.621911+0000","last_undegraded":"2024-09-10T11:40:54.621911+0000","last_fullsized":"2024-09-10T11:40:54.621911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:59:18.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:29.619750+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:40:29.619750+0000","last_peered":"2024-09-10T11:40:29.619750+0000","last_clean":"2024-09-10T11:40:29.619750+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:40:29.619750+0000","last_undegraded":"2024-09-10T11:40:29.619750+0000","last_fullsized":"2024-09-10T11:40:29.619750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623219+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:40:44.623219+0000","last_peered":"2024-09-10T11:40:44.623219+0000","last_clean":"2024-09-10T11:40:44.623219+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:40:44.623219+0000","last_undegraded":"2024-09-10T11:40:44.623219+0000","last_fullsized":"2024-09-10T11:40:44.623219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.622831+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:40:44.622831+0000","last_peered":"2024-09-10T11:40:44.622831+0000","last_clean":"2024-09-10T11:40:44.622831+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:40:44.622831+0000","last_undegraded":"2024-09-10T11:40:44.622831+0000","last_fullsized":"2024-09-10T11:40:44.622831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.620590+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:40:39.620590+0000","last_peered":"2024-09-10T11:40:39.620590+0000","last_clean":"2024-09-10T11:40:39.620590+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:40:39.620590+0000","last_undegraded":"2024-09-10T11:40:39.620590+0000","last_fullsized":"2024-09-10T11:40:39.620590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626782+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:40:44.626782+0000","last_peered":"2024-09-10T11:40:44.626782+0000","last_clean":"2024-09-10T11:40:44.626782+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:40:44.626782+0000","last_undegraded":"2024-09-10T11:40:44.626782+0000","last_fullsized":"2024-09-10T11:40:44.626782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624248+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:40:44.624248+0000","last_peered":"2024-09-10T11:40:44.624248+0000","last_clean":"2024-09-10T11:40:44.624248+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:40:44.624248+0000","last_undegraded":"2024-09-10T11:40:44.624248+0000","last_fullsized":"2024-09-10T11:40:44.624248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.625159+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:40:39.625159+0000","last_peered":"2024-09-10T11:40:39.625159+0000","last_clean":"2024-09-10T11:40:39.625159+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:40:39.625159+0000","last_undegraded":"2024-09-10T11:40:39.625159+0000","last_fullsized":"2024-09-10T11:40:39.625159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623205+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:40:44.623205+0000","last_peered":"2024-09-10T11:40:44.623205+0000","last_clean":"2024-09-10T11:40:44.623205+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:40:44.623205+0000","last_undegraded":"2024-09-10T11:40:44.623205+0000","last_fullsized":"2024-09-10T11:40:44.623205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620398+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:40:44.620398+0000","last_peered":"2024-09-10T11:40:44.620398+0000","last_clean":"2024-09-10T11:40:44.620398+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:40:44.620398+0000","last_undegraded":"2024-09-10T11:40:44.620398+0000","last_fullsized":"2024-09-10T11:40:44.620398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625693+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:40:44.625693+0000","last_peered":"2024-09-10T11:40:44.625693+0000","last_clean":"2024-09-10T11:40:44.625693+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:40:44.625693+0000","last_undegraded":"2024-09-10T11:40:44.625693+0000","last_fullsized":"2024-09-10T11:40:44.625693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623247+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:40:44.623247+0000","last_peered":"2024-09-10T11:40:44.623247+0000","last_clean":"2024-09-10T11:40:44.623247+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:40:44.623247+0000","last_undegraded":"2024-09-10T11:40:44.623247+0000","last_fullsized":"2024-09-10T11:40:44.623247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620999+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:40:44.620999+0000","last_peered":"2024-09-10T11:40:44.620999+0000","last_clean":"2024-09-10T11:40:44.620999+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:40:44.620999+0000","last_undegraded":"2024-09-10T11:40:44.620999+0000","last_fullsized":"2024-09-10T11:40:44.620999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625670+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:40:44.625670+0000","last_peered":"2024-09-10T11:40:44.625670+0000","last_clean":"2024-09-10T11:40:44.625670+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:40:44.625670+0000","last_undegraded":"2024-09-10T11:40:44.625670+0000","last_fullsized":"2024-09-10T11:40:44.625670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626109+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:40:49.626109+0000","last_peered":"2024-09-10T11:40:49.626109+0000","last_clean":"2024-09-10T11:40:49.626109+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:40:49.626109+0000","last_undegraded":"2024-09-10T11:40:49.626109+0000","last_fullsized":"2024-09-10T11:40:49.626109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623400+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:40:49.623400+0000","last_peered":"2024-09-10T11:40:49.623400+0000","last_clean":"2024-09-10T11:40:49.623400+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:40:49.623400+0000","last_undegraded":"2024-09-10T11:40:49.623400+0000","last_fullsized":"2024-09-10T11:40:49.623400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628559+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:40:44.628559+0000","last_peered":"2024-09-10T11:40:44.628559+0000","last_clean":"2024-09-10T11:40:44.628559+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:40:44.628559+0000","last_undegraded":"2024-09-10T11:40:44.628559+0000","last_fullsized":"2024-09-10T11:40:44.628559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.627338+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:40:49.627338+0000","last_peered":"2024-09-10T11:40:49.627338+0000","last_clean":"2024-09-10T11:40:49.627338+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:40:49.627338+0000","last_undegraded":"2024-09-10T11:40:49.627338+0000","last_fullsized":"2024-09-10T11:40:49.627338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.621460+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:40:49.621460+0000","last_peered":"2024-09-10T11:40:49.621460+0000","last_clean":"2024-09-10T11:40:49.621460+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:40:49.621460+0000","last_undegraded":"2024-09-10T11:40:49.621460+0000","last_fullsized":"2024-09-10T11:40:49.621460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.620745+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:40:49.620745+0000","last_peered":"2024-09-10T11:40:49.620745+0000","last_clean":"2024-09-10T11:40:49.620745+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:40:49.620745+0000","last_undegraded":"2024-09-10T11:40:49.620745+0000","last_fullsized":"2024-09-10T11:40:49.620745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626053+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:40:49.626053+0000","last_peered":"2024-09-10T11:40:49.626053+0000","last_clean":"2024-09-10T11:40:49.626053+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:40:49.626053+0000","last_undegraded":"2024-09-10T11:40:49.626053+0000","last_fullsized":"2024-09-10T11:40:49.626053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623309+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:40:49.623309+0000","last_peered":"2024-09-10T11:40:49.623309+0000","last_clean":"2024-09-10T11:40:49.623309+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:40:49.623309+0000","last_undegraded":"2024-09-10T11:40:49.623309+0000","last_fullsized":"2024-09-10T11:40:49.623309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626069+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:40:49.626069+0000","last_peered":"2024-09-10T11:40:49.626069+0000","last_clean":"2024-09-10T11:40:49.626069+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:40:49.626069+0000","last_undegraded":"2024-09-10T11:40:49.626069+0000","last_fullsized":"2024-09-10T11:40:49.626069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623833+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:40:54.623833+0000","last_peered":"2024-09-10T11:40:54.623833+0000","last_clean":"2024-09-10T11:40:54.623833+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:40:54.623833+0000","last_undegraded":"2024-09-10T11:40:54.623833+0000","last_fullsized":"2024-09-10T11:40:54.623833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621892+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:40:54.621892+0000","last_peered":"2024-09-10T11:40:54.621892+0000","last_clean":"2024-09-10T11:40:54.621892+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:40:54.621892+0000","last_undegraded":"2024-09-10T11:40:54.621892+0000","last_fullsized":"2024-09-10T11:40:54.621892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628879+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:40:49.628879+0000","last_peered":"2024-09-10T11:40:49.628879+0000","last_clean":"2024-09-10T11:40:49.628879+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:40:49.628879+0000","last_undegraded":"2024-09-10T11:40:49.628879+0000","last_fullsized":"2024-09-10T11:40:49.628879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625564+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:41:09.625564+0000","last_peered":"2024-09-10T11:41:09.625564+0000","last_clean":"2024-09-10T11:41:09.625564+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:41:09.625564+0000","last_undegraded":"2024-09-10T11:41:09.625564+0000","last_fullsized":"2024-09-10T11:41:09.625564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623159+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:41:09.623159+0000","last_peered":"2024-09-10T11:41:09.623159+0000","last_clean":"2024-09-10T11:41:09.623159+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:41:09.623159+0000","last_undegraded":"2024-09-10T11:41:09.623159+0000","last_fullsized":"2024-09-10T11:41:09.623159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625550+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:41:09.625550+0000","last_peered":"2024-09-10T11:41:09.625550+0000","last_clean":"2024-09-10T11:41:09.625550+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:41:09.625550+0000","last_undegraded":"2024-09-10T11:41:09.625550+0000","last_fullsized":"2024-09-10T11:41:09.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623179+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:41:09.623179+0000","last_peered":"2024-09-10T11:41:09.623179+0000","last_clean":"2024-09-10T11:41:09.623179+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:41:09.623179+0000","last_undegraded":"2024-09-10T11:41:09.623179+0000","last_fullsized":"2024-09-10T11:41:09.623179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626847+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:40:44.626847+0000","last_peered":"2024-09-10T11:40:44.626847+0000","last_clean":"2024-09-10T11:40:44.626847+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:40:44.626847+0000","last_undegraded":"2024-09-10T11:40:44.626847+0000","last_fullsized":"2024-09-10T11:40:44.626847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622362+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:40:39.622362+0000","last_peered":"2024-09-10T11:40:39.622362+0000","last_clean":"2024-09-10T11:40:39.622362+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:40:39.622362+0000","last_undegraded":"2024-09-10T11:40:39.622362+0000","last_fullsized":"2024-09-10T11:40:39.622362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622337+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:40:39.622337+0000","last_peered":"2024-09-10T11:40:39.622337+0000","last_clean":"2024-09-10T11:40:39.622337+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:40:39.622337+0000","last_undegraded":"2024-09-10T11:40:39.622337+0000","last_fullsized":"2024-09-10T11:40:39.622337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626866+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:40:44.626866+0000","last_peered":"2024-09-10T11:40:44.626866+0000","last_clean":"2024-09-10T11:40:44.626866+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:40:44.626866+0000","last_undegraded":"2024-09-10T11:40:44.626866+0000","last_fullsized":"2024-09-10T11:40:44.626866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":678737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":87877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":87913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":87787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":249856,"data_stored":87947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":678793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:43:50.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 -- 172.21.15.57:0/2844364225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0072cc0 msgr2=0x7feec0074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 --2- 172.21.15.57:0/2844364225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0072cc0 0x7feec0074890 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feec00c7250 tx=0x7feeb002a560 comp rx=0 tx=0).stop 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 -- 172.21.15.57:0/2844364225 shutdown_connections 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 --2- 172.21.15.57:0/2844364225 >> v2:172.21.15.154:3300/0 conn(0x7feec006ee70 0x7feec006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 --2- 172.21.15.57:0/2844364225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0072cc0 0x7feec0074890 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 -- 172.21.15.57:0/2844364225 >> 172.21.15.57:0/2844364225 conn(0x7feec00ccc70 msgr2=0x7feec00cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:51.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 -- 172.21.15.57:0/2844364225 shutdown_connections 2024-09-10T11:43:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.047+0000 7feec4d90640 1 -- 172.21.15.57:0/2844364225 wait complete. 2024-09-10T11:43:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.048+0000 7feec4d90640 1 Processor -- start 2024-09-10T11:43:51.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.048+0000 7feec4d90640 1 -- start start 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feec4d90640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec006ee70 0x7feec00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feec4d90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec0072cc0 0x7feec01f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feec4d90640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 0x7feec00d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feec4d90640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7feec00cba20 con 0x7feec0074360 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feec4d90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feec00cb8a0 con 0x7feec0072cc0 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feec4d90640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7feec006f840 con 0x7feec006ee70 2024-09-10T11:43:51.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 0x7feec00d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebe59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec006ee70 0x7feec00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebed9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 0x7feec00d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38848/0 (socket says 172.21.15.57:38848) 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebe59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec006ee70 0x7feec00b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:54266/0 (socket says 172.21.15.57:54266) 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebed9d640 1 -- 172.21.15.57:0/3912389844 learned_addr learned my addr 172.21.15.57:0/3912389844 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebdd9b640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec0072cc0 0x7feec01f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebed9d640 1 -- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec006ee70 msgr2=0x7feec00b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebed9d640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec006ee70 0x7feec00b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.049+0000 7feebed9d640 1 -- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec0072cc0 msgr2=0x7feec01f7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feebed9d640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec0072cc0 0x7feec01f7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feebed9d640 1 -- 172.21.15.57:0/3912389844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec00acf80 con 0x7feec0074360 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feebed9d640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 0x7feec00d0180 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feeb800eb10 tx=0x7feeb800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8004b20 con 0x7feec0074360 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb8004ce0 con 0x7feec0074360 2024-09-10T11:43:51.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8005280 con 0x7feec0074360 2024-09-10T11:43:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.050+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec00ad260 con 0x7feec0074360 2024-09-10T11:43:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.051+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec00ad820 con 0x7feec0074360 2024-09-10T11:43:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.052+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec006fd30 con 0x7feec0074360 2024-09-10T11:43:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.052+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7feeb8005420 con 0x7feec0074360 2024-09-10T11:43:51.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.053+0000 7feeaeffd640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feea00750a0 0x7feea0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.053+0000 7feebe59c640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feea00750a0 0x7feea0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.053+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7feeb8096fa0 con 0x7feec0074360 2024-09-10T11:43:51.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.054+0000 7feebe59c640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feea00750a0 0x7feea0077560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feeb0033000 tx=0x7feeb0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:51.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.057+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7feeb8060c20 con 0x7feec0074360 2024-09-10T11:43:51.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.283+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feec006d8e0 con 0x7feea00750a0 2024-09-10T11:43:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.287+0000 7feeaeffd640 1 -- 172.21.15.57:0/3912389844 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251818 (secure 0 0 0) 0x7feec006d8e0 con 0x7feea00750a0 2024-09-10T11:43:51.291 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:51.292 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:43:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feea00750a0 msgr2=0x7feea0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feea00750a0 0x7feea0077560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feeb0033000 tx=0x7feeb0004730 comp rx=0 tx=0).stop 2024-09-10T11:43:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 msgr2=0x7feec00d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 0x7feec00d0180 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feeb800eb10 tx=0x7feeb800c2d0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 shutdown_connections 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7feea00750a0 0x7feea0077560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feec0074360 0x7feec00d0180 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec0072cc0 0x7feec01f7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 --2- 172.21.15.57:0/3912389844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec006ee70 0x7feec00b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.290+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 >> 172.21.15.57:0/3912389844 conn(0x7feec00ccc70 msgr2=0x7feec015cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.291+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 shutdown_connections 2024-09-10T11:43:51.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.291+0000 7feec4d90640 1 -- 172.21.15.57:0/3912389844 wait complete. 2024-09-10T11:43:51.304 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T11:43:50.250572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235988,"kb_used_data":3112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738732,"statfs":{"total":773094113280,"available":772852461568,"internally_reserved":0,"allocated":3186688,"data_stored":1887852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.621023+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:40:44.621023+0000","last_peered":"2024-09-10T11:40:44.621023+0000","last_clean":"2024-09-10T11:40:44.621023+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:40:44.621023+0000","last_undegraded":"2024-09-10T11:40:44.621023+0000","last_fullsized":"2024-09-10T11:40:44.621023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625716+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:40:44.625716+0000","last_peered":"2024-09-10T11:40:44.625716+0000","last_clean":"2024-09-10T11:40:44.625716+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:40:44.625716+0000","last_undegraded":"2024-09-10T11:40:44.625716+0000","last_fullsized":"2024-09-10T11:40:44.625716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626827+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:40:44.626827+0000","last_peered":"2024-09-10T11:40:44.626827+0000","last_clean":"2024-09-10T11:40:44.626827+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:40:44.626827+0000","last_undegraded":"2024-09-10T11:40:44.626827+0000","last_fullsized":"2024-09-10T11:40:44.626827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622727+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:40:39.622727+0000","last_peered":"2024-09-10T11:40:39.622727+0000","last_clean":"2024-09-10T11:40:39.622727+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:40:39.622727+0000","last_undegraded":"2024-09-10T11:40:39.622727+0000","last_fullsized":"2024-09-10T11:40:39.622727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623143+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:41:09.623143+0000","last_peered":"2024-09-10T11:41:09.623143+0000","last_clean":"2024-09-10T11:41:09.623143+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:41:09.623143+0000","last_undegraded":"2024-09-10T11:41:09.623143+0000","last_fullsized":"2024-09-10T11:41:09.623143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625526+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:41:09.625526+0000","last_peered":"2024-09-10T11:41:09.625526+0000","last_clean":"2024-09-10T11:41:09.625526+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:41:09.625526+0000","last_undegraded":"2024-09-10T11:41:09.625526+0000","last_fullsized":"2024-09-10T11:41:09.625526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623125+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:41:09.623125+0000","last_peered":"2024-09-10T11:41:09.623125+0000","last_clean":"2024-09-10T11:41:09.623125+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:41:09.623125+0000","last_undegraded":"2024-09-10T11:41:09.623125+0000","last_fullsized":"2024-09-10T11:41:09.623125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625143+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:41:09.625143+0000","last_peered":"2024-09-10T11:41:09.625143+0000","last_clean":"2024-09-10T11:41:09.625143+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:41:09.625143+0000","last_undegraded":"2024-09-10T11:41:09.625143+0000","last_fullsized":"2024-09-10T11:41:09.625143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622777+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:41:04.622777+0000","last_peered":"2024-09-10T11:41:04.622777+0000","last_clean":"2024-09-10T11:41:04.622777+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:41:04.622777+0000","last_undegraded":"2024-09-10T11:41:04.622777+0000","last_fullsized":"2024-09-10T11:41:04.622777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630356+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:41:04.630356+0000","last_peered":"2024-09-10T11:41:04.630356+0000","last_clean":"2024-09-10T11:41:04.630356+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:41:04.630356+0000","last_undegraded":"2024-09-10T11:41:04.630356+0000","last_fullsized":"2024-09-10T11:41:04.630356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630342+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:41:04.630342+0000","last_peered":"2024-09-10T11:41:04.630342+0000","last_clean":"2024-09-10T11:41:04.630342+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:41:04.630342+0000","last_undegraded":"2024-09-10T11:41:04.630342+0000","last_fullsized":"2024-09-10T11:41:04.630342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.621969+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:41:04.621969+0000","last_peered":"2024-09-10T11:41:04.621969+0000","last_clean":"2024-09-10T11:41:04.621969+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:41:04.621969+0000","last_undegraded":"2024-09-10T11:41:04.621969+0000","last_fullsized":"2024-09-10T11:41:04.621969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:39:19.616974+0000","last_change":"2024-09-10T11:39:17.817004+0000","last_active":"2024-09-10T11:39:19.616974+0000","last_peered":"2024-09-10T11:39:19.616974+0000","last_clean":"2024-09-10T11:39:19.616974+0000","last_became_active":"2024-09-10T11:39:17.816727+0000","last_became_peered":"2024-09-10T11:39:17.816727+0000","last_unstale":"2024-09-10T11:39:19.616974+0000","last_undegraded":"2024-09-10T11:39:19.616974+0000","last_fullsized":"2024-09-10T11:39:19.616974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628297+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:40:59.628297+0000","last_peered":"2024-09-10T11:40:59.628297+0000","last_clean":"2024-09-10T11:40:59.628297+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:40:59.628297+0000","last_undegraded":"2024-09-10T11:40:59.628297+0000","last_fullsized":"2024-09-10T11:40:59.628297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.626910+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:40:59.626910+0000","last_peered":"2024-09-10T11:40:59.626910+0000","last_clean":"2024-09-10T11:40:59.626910+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:40:59.626910+0000","last_undegraded":"2024-09-10T11:40:59.626910+0000","last_fullsized":"2024-09-10T11:40:59.626910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624584+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:40:59.624584+0000","last_peered":"2024-09-10T11:40:59.624584+0000","last_clean":"2024-09-10T11:40:59.624584+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:40:59.624584+0000","last_undegraded":"2024-09-10T11:40:59.624584+0000","last_fullsized":"2024-09-10T11:40:59.624584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624632+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:40:59.624632+0000","last_peered":"2024-09-10T11:40:59.624632+0000","last_clean":"2024-09-10T11:40:59.624632+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:40:59.624632+0000","last_undegraded":"2024-09-10T11:40:59.624632+0000","last_fullsized":"2024-09-10T11:40:59.624632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625550+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:40:59.625550+0000","last_peered":"2024-09-10T11:40:59.625550+0000","last_clean":"2024-09-10T11:40:59.625550+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:40:59.625550+0000","last_undegraded":"2024-09-10T11:40:59.625550+0000","last_fullsized":"2024-09-10T11:40:59.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621920+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:40:54.621920+0000","last_peered":"2024-09-10T11:40:54.621920+0000","last_clean":"2024-09-10T11:40:54.621920+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:40:54.621920+0000","last_undegraded":"2024-09-10T11:40:54.621920+0000","last_fullsized":"2024-09-10T11:40:54.621920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629284+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:40:54.629284+0000","last_peered":"2024-09-10T11:40:54.629284+0000","last_clean":"2024-09-10T11:40:54.629284+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:40:54.629284+0000","last_undegraded":"2024-09-10T11:40:54.629284+0000","last_fullsized":"2024-09-10T11:40:54.629284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629142+0000","last_change":"2024-09-10T11:39:17.816383+0000","last_active":"2024-09-10T11:41:34.629142+0000","last_peered":"2024-09-10T11:41:34.629142+0000","last_clean":"2024-09-10T11:41:34.629142+0000","last_became_active":"2024-09-10T11:39:17.816084+0000","last_became_peered":"2024-09-10T11:39:17.816084+0000","last_unstale":"2024-09-10T11:41:34.629142+0000","last_undegraded":"2024-09-10T11:41:34.629142+0000","last_fullsized":"2024-09-10T11:41:34.629142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629050+0000","last_change":"2024-09-10T11:39:17.814534+0000","last_active":"2024-09-10T11:41:34.629050+0000","last_peered":"2024-09-10T11:41:34.629050+0000","last_clean":"2024-09-10T11:41:34.629050+0000","last_became_active":"2024-09-10T11:39:17.814205+0000","last_became_peered":"2024-09-10T11:39:17.814205+0000","last_unstale":"2024-09-10T11:41:34.629050+0000","last_undegraded":"2024-09-10T11:41:34.629050+0000","last_fullsized":"2024-09-10T11:41:34.629050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623787+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:40:54.623787+0000","last_peered":"2024-09-10T11:40:54.623787+0000","last_clean":"2024-09-10T11:40:54.623787+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:40:54.623787+0000","last_undegraded":"2024-09-10T11:40:54.623787+0000","last_fullsized":"2024-09-10T11:40:54.623787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623688+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:40:49.623688+0000","last_peered":"2024-09-10T11:40:49.623688+0000","last_clean":"2024-09-10T11:40:49.623688+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:40:49.623688+0000","last_undegraded":"2024-09-10T11:40:49.623688+0000","last_fullsized":"2024-09-10T11:40:49.623688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623386+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:40:49.623386+0000","last_peered":"2024-09-10T11:40:49.623386+0000","last_clean":"2024-09-10T11:40:49.623386+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:40:49.623386+0000","last_undegraded":"2024-09-10T11:40:49.623386+0000","last_fullsized":"2024-09-10T11:40:49.623386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628912+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:40:49.628912+0000","last_peered":"2024-09-10T11:40:49.628912+0000","last_clean":"2024-09-10T11:40:49.628912+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:40:49.628912+0000","last_undegraded":"2024-09-10T11:40:49.628912+0000","last_fullsized":"2024-09-10T11:40:49.628912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626088+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:40:49.626088+0000","last_peered":"2024-09-10T11:40:49.626088+0000","last_clean":"2024-09-10T11:40:49.626088+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:40:49.626088+0000","last_undegraded":"2024-09-10T11:40:49.626088+0000","last_fullsized":"2024-09-10T11:40:49.626088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623363+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:40:49.623363+0000","last_peered":"2024-09-10T11:40:49.623363+0000","last_clean":"2024-09-10T11:40:49.623363+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:40:49.623363+0000","last_undegraded":"2024-09-10T11:40:49.623363+0000","last_fullsized":"2024-09-10T11:40:49.623363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626811+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:40:44.626811+0000","last_peered":"2024-09-10T11:40:44.626811+0000","last_clean":"2024-09-10T11:40:44.626811+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:40:44.626811+0000","last_undegraded":"2024-09-10T11:40:44.626811+0000","last_fullsized":"2024-09-10T11:40:44.626811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623181+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:40:44.623181+0000","last_peered":"2024-09-10T11:40:44.623181+0000","last_clean":"2024-09-10T11:40:44.623181+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:40:44.623181+0000","last_undegraded":"2024-09-10T11:40:44.623181+0000","last_fullsized":"2024-09-10T11:40:44.623181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624234+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:40:44.624234+0000","last_peered":"2024-09-10T11:40:44.624234+0000","last_clean":"2024-09-10T11:40:44.624234+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:40:44.624234+0000","last_undegraded":"2024-09-10T11:40:44.624234+0000","last_fullsized":"2024-09-10T11:40:44.624234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628530+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:40:44.628530+0000","last_peered":"2024-09-10T11:40:44.628530+0000","last_clean":"2024-09-10T11:40:44.628530+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:40:44.628530+0000","last_undegraded":"2024-09-10T11:40:44.628530+0000","last_fullsized":"2024-09-10T11:40:44.628530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.622330+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:41:09.622330+0000","last_peered":"2024-09-10T11:41:09.622330+0000","last_clean":"2024-09-10T11:41:09.622330+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:41:09.622330+0000","last_undegraded":"2024-09-10T11:41:09.622330+0000","last_fullsized":"2024-09-10T11:41:09.622330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625179+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:41:09.625179+0000","last_peered":"2024-09-10T11:41:09.625179+0000","last_clean":"2024-09-10T11:41:09.625179+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:41:09.625179+0000","last_undegraded":"2024-09-10T11:41:09.625179+0000","last_fullsized":"2024-09-10T11:41:09.625179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.629118+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:41:09.629118+0000","last_peered":"2024-09-10T11:41:09.629118+0000","last_clean":"2024-09-10T11:41:09.629118+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:41:09.629118+0000","last_undegraded":"2024-09-10T11:41:09.629118+0000","last_fullsized":"2024-09-10T11:41:09.629118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630315+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:41:04.630315+0000","last_peered":"2024-09-10T11:41:04.630315+0000","last_clean":"2024-09-10T11:41:04.630315+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:41:04.630315+0000","last_undegraded":"2024-09-10T11:41:04.630315+0000","last_fullsized":"2024-09-10T11:41:04.630315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624745+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:41:04.624745+0000","last_peered":"2024-09-10T11:41:04.624745+0000","last_clean":"2024-09-10T11:41:04.624745+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:41:04.624745+0000","last_undegraded":"2024-09-10T11:41:04.624745+0000","last_fullsized":"2024-09-10T11:41:04.624745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624715+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:41:04.624715+0000","last_peered":"2024-09-10T11:41:04.624715+0000","last_clean":"2024-09-10T11:41:04.624715+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:41:04.624715+0000","last_undegraded":"2024-09-10T11:41:04.624715+0000","last_fullsized":"2024-09-10T11:41:04.624715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625081+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:41:04.625081+0000","last_peered":"2024-09-10T11:41:04.625081+0000","last_clean":"2024-09-10T11:41:04.625081+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:41:04.625081+0000","last_undegraded":"2024-09-10T11:41:04.625081+0000","last_fullsized":"2024-09-10T11:41:04.625081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627391+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:41:04.627391+0000","last_peered":"2024-09-10T11:41:04.627391+0000","last_clean":"2024-09-10T11:41:04.627391+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:41:04.627391+0000","last_undegraded":"2024-09-10T11:41:04.627391+0000","last_fullsized":"2024-09-10T11:41:04.627391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629889+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:40:59.629889+0000","last_peered":"2024-09-10T11:40:59.629889+0000","last_clean":"2024-09-10T11:40:59.629889+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:40:59.629889+0000","last_undegraded":"2024-09-10T11:40:59.629889+0000","last_fullsized":"2024-09-10T11:40:59.629889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625128+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:41:04.625128+0000","last_peered":"2024-09-10T11:41:04.625128+0000","last_clean":"2024-09-10T11:41:04.625128+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:41:04.625128+0000","last_undegraded":"2024-09-10T11:41:04.625128+0000","last_fullsized":"2024-09-10T11:41:04.625128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625143+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:41:04.625143+0000","last_peered":"2024-09-10T11:41:04.625143+0000","last_clean":"2024-09-10T11:41:04.625143+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:41:04.625143+0000","last_undegraded":"2024-09-10T11:41:04.625143+0000","last_fullsized":"2024-09-10T11:41:04.625143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.628725+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:41:04.628725+0000","last_peered":"2024-09-10T11:41:04.628725+0000","last_clean":"2024-09-10T11:41:04.628725+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:41:04.628725+0000","last_undegraded":"2024-09-10T11:41:04.628725+0000","last_fullsized":"2024-09-10T11:41:04.628725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627434+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:41:04.627434+0000","last_peered":"2024-09-10T11:41:04.627434+0000","last_clean":"2024-09-10T11:41:04.627434+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:41:04.627434+0000","last_undegraded":"2024-09-10T11:41:04.627434+0000","last_fullsized":"2024-09-10T11:41:04.627434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.621604+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:40:59.621604+0000","last_peered":"2024-09-10T11:40:59.621604+0000","last_clean":"2024-09-10T11:40:59.621604+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:40:59.621604+0000","last_undegraded":"2024-09-10T11:40:59.621604+0000","last_fullsized":"2024-09-10T11:40:59.621604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629292+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:40:54.629292+0000","last_peered":"2024-09-10T11:40:54.629292+0000","last_clean":"2024-09-10T11:40:54.629292+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:40:54.629292+0000","last_undegraded":"2024-09-10T11:40:54.629292+0000","last_fullsized":"2024-09-10T11:40:54.629292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622743+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:41:04.622743+0000","last_peered":"2024-09-10T11:41:04.622743+0000","last_clean":"2024-09-10T11:41:04.622743+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:41:04.622743+0000","last_undegraded":"2024-09-10T11:41:04.622743+0000","last_fullsized":"2024-09-10T11:41:04.622743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628332+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:40:59.628332+0000","last_peered":"2024-09-10T11:40:59.628332+0000","last_clean":"2024-09-10T11:40:59.628332+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:40:59.628332+0000","last_undegraded":"2024-09-10T11:40:59.628332+0000","last_fullsized":"2024-09-10T11:40:59.628332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628319+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:40:59.628319+0000","last_peered":"2024-09-10T11:40:59.628319+0000","last_clean":"2024-09-10T11:40:59.628319+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:40:59.628319+0000","last_undegraded":"2024-09-10T11:40:59.628319+0000","last_fullsized":"2024-09-10T11:40:59.628319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624605+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:40:59.624605+0000","last_peered":"2024-09-10T11:40:59.624605+0000","last_clean":"2024-09-10T11:40:59.624605+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:40:59.624605+0000","last_undegraded":"2024-09-10T11:40:59.624605+0000","last_fullsized":"2024-09-10T11:40:59.624605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622311+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:40:59.622311+0000","last_peered":"2024-09-10T11:40:59.622311+0000","last_clean":"2024-09-10T11:40:59.622311+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:40:59.622311+0000","last_undegraded":"2024-09-10T11:40:59.622311+0000","last_fullsized":"2024-09-10T11:40:59.622311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629268+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:40:54.629268+0000","last_peered":"2024-09-10T11:40:54.629268+0000","last_clean":"2024-09-10T11:40:54.629268+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:40:54.629268+0000","last_undegraded":"2024-09-10T11:40:54.629268+0000","last_fullsized":"2024-09-10T11:40:54.629268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629850+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:40:59.629850+0000","last_peered":"2024-09-10T11:40:59.629850+0000","last_clean":"2024-09-10T11:40:59.629850+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:40:59.629850+0000","last_undegraded":"2024-09-10T11:40:59.629850+0000","last_fullsized":"2024-09-10T11:40:59.629850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625504+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:40:59.625504+0000","last_peered":"2024-09-10T11:40:59.625504+0000","last_clean":"2024-09-10T11:40:59.625504+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:40:59.625504+0000","last_undegraded":"2024-09-10T11:40:59.625504+0000","last_fullsized":"2024-09-10T11:40:59.625504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622290+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:40:59.622290+0000","last_peered":"2024-09-10T11:40:59.622290+0000","last_clean":"2024-09-10T11:40:59.622290+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:40:59.622290+0000","last_undegraded":"2024-09-10T11:40:59.622290+0000","last_fullsized":"2024-09-10T11:40:59.622290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621204+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:40:54.621204+0000","last_peered":"2024-09-10T11:40:54.621204+0000","last_clean":"2024-09-10T11:40:54.621204+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:40:54.621204+0000","last_undegraded":"2024-09-10T11:40:54.621204+0000","last_fullsized":"2024-09-10T11:40:54.621204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621928+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:40:54.621928+0000","last_peered":"2024-09-10T11:40:54.621928+0000","last_clean":"2024-09-10T11:40:54.621928+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:40:54.621928+0000","last_undegraded":"2024-09-10T11:40:54.621928+0000","last_fullsized":"2024-09-10T11:40:54.621928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625183+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:40:54.625183+0000","last_peered":"2024-09-10T11:40:54.625183+0000","last_clean":"2024-09-10T11:40:54.625183+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:40:54.625183+0000","last_undegraded":"2024-09-10T11:40:54.625183+0000","last_fullsized":"2024-09-10T11:40:54.625183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621937+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:40:54.621937+0000","last_peered":"2024-09-10T11:40:54.621937+0000","last_clean":"2024-09-10T11:40:54.621937+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:40:54.621937+0000","last_undegraded":"2024-09-10T11:40:54.621937+0000","last_fullsized":"2024-09-10T11:40:54.621937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.626566+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:40:54.626566+0000","last_peered":"2024-09-10T11:40:54.626566+0000","last_clean":"2024-09-10T11:40:54.626566+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:40:54.626566+0000","last_undegraded":"2024-09-10T11:40:54.626566+0000","last_fullsized":"2024-09-10T11:40:54.626566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.624181+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:40:54.624181+0000","last_peered":"2024-09-10T11:40:54.624181+0000","last_clean":"2024-09-10T11:40:54.624181+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:40:54.624181+0000","last_undegraded":"2024-09-10T11:40:54.624181+0000","last_fullsized":"2024-09-10T11:40:54.624181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625163+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:40:54.625163+0000","last_peered":"2024-09-10T11:40:54.625163+0000","last_clean":"2024-09-10T11:40:54.625163+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:40:54.625163+0000","last_undegraded":"2024-09-10T11:40:54.625163+0000","last_fullsized":"2024-09-10T11:40:54.625163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621911+0000","last_change":"2024-09-10T11:39:18.205415+0000","last_active":"2024-09-10T11:40:54.621911+0000","last_peered":"2024-09-10T11:40:54.621911+0000","last_clean":"2024-09-10T11:40:54.621911+0000","last_became_active":"2024-09-10T11:39:18.205081+0000","last_became_peered":"2024-09-10T11:39:18.205081+0000","last_unstale":"2024-09-10T11:40:54.621911+0000","last_undegraded":"2024-09-10T11:40:54.621911+0000","last_fullsized":"2024-09-10T11:40:54.621911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:59:18.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:29.619750+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:40:29.619750+0000","last_peered":"2024-09-10T11:40:29.619750+0000","last_clean":"2024-09-10T11:40:29.619750+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:40:29.619750+0000","last_undegraded":"2024-09-10T11:40:29.619750+0000","last_fullsized":"2024-09-10T11:40:29.619750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623219+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:40:44.623219+0000","last_peered":"2024-09-10T11:40:44.623219+0000","last_clean":"2024-09-10T11:40:44.623219+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:40:44.623219+0000","last_undegraded":"2024-09-10T11:40:44.623219+0000","last_fullsized":"2024-09-10T11:40:44.623219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.622831+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:40:44.622831+0000","last_peered":"2024-09-10T11:40:44.622831+0000","last_clean":"2024-09-10T11:40:44.622831+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:40:44.622831+0000","last_undegraded":"2024-09-10T11:40:44.622831+0000","last_fullsized":"2024-09-10T11:40:44.622831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.620590+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:40:39.620590+0000","last_peered":"2024-09-10T11:40:39.620590+0000","last_clean":"2024-09-10T11:40:39.620590+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:40:39.620590+0000","last_undegraded":"2024-09-10T11:40:39.620590+0000","last_fullsized":"2024-09-10T11:40:39.620590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626782+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:40:44.626782+0000","last_peered":"2024-09-10T11:40:44.626782+0000","last_clean":"2024-09-10T11:40:44.626782+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:40:44.626782+0000","last_undegraded":"2024-09-10T11:40:44.626782+0000","last_fullsized":"2024-09-10T11:40:44.626782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624248+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:40:44.624248+0000","last_peered":"2024-09-10T11:40:44.624248+0000","last_clean":"2024-09-10T11:40:44.624248+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:40:44.624248+0000","last_undegraded":"2024-09-10T11:40:44.624248+0000","last_fullsized":"2024-09-10T11:40:44.624248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.625159+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:40:39.625159+0000","last_peered":"2024-09-10T11:40:39.625159+0000","last_clean":"2024-09-10T11:40:39.625159+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:40:39.625159+0000","last_undegraded":"2024-09-10T11:40:39.625159+0000","last_fullsized":"2024-09-10T11:40:39.625159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623205+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:40:44.623205+0000","last_peered":"2024-09-10T11:40:44.623205+0000","last_clean":"2024-09-10T11:40:44.623205+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:40:44.623205+0000","last_undegraded":"2024-09-10T11:40:44.623205+0000","last_fullsized":"2024-09-10T11:40:44.623205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620398+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:40:44.620398+0000","last_peered":"2024-09-10T11:40:44.620398+0000","last_clean":"2024-09-10T11:40:44.620398+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:40:44.620398+0000","last_undegraded":"2024-09-10T11:40:44.620398+0000","last_fullsized":"2024-09-10T11:40:44.620398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625693+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:40:44.625693+0000","last_peered":"2024-09-10T11:40:44.625693+0000","last_clean":"2024-09-10T11:40:44.625693+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:40:44.625693+0000","last_undegraded":"2024-09-10T11:40:44.625693+0000","last_fullsized":"2024-09-10T11:40:44.625693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623247+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:40:44.623247+0000","last_peered":"2024-09-10T11:40:44.623247+0000","last_clean":"2024-09-10T11:40:44.623247+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:40:44.623247+0000","last_undegraded":"2024-09-10T11:40:44.623247+0000","last_fullsized":"2024-09-10T11:40:44.623247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620999+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:40:44.620999+0000","last_peered":"2024-09-10T11:40:44.620999+0000","last_clean":"2024-09-10T11:40:44.620999+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:40:44.620999+0000","last_undegraded":"2024-09-10T11:40:44.620999+0000","last_fullsized":"2024-09-10T11:40:44.620999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625670+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:40:44.625670+0000","last_peered":"2024-09-10T11:40:44.625670+0000","last_clean":"2024-09-10T11:40:44.625670+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:40:44.625670+0000","last_undegraded":"2024-09-10T11:40:44.625670+0000","last_fullsized":"2024-09-10T11:40:44.625670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626109+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:40:49.626109+0000","last_peered":"2024-09-10T11:40:49.626109+0000","last_clean":"2024-09-10T11:40:49.626109+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:40:49.626109+0000","last_undegraded":"2024-09-10T11:40:49.626109+0000","last_fullsized":"2024-09-10T11:40:49.626109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623400+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:40:49.623400+0000","last_peered":"2024-09-10T11:40:49.623400+0000","last_clean":"2024-09-10T11:40:49.623400+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:40:49.623400+0000","last_undegraded":"2024-09-10T11:40:49.623400+0000","last_fullsized":"2024-09-10T11:40:49.623400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628559+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:40:44.628559+0000","last_peered":"2024-09-10T11:40:44.628559+0000","last_clean":"2024-09-10T11:40:44.628559+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:40:44.628559+0000","last_undegraded":"2024-09-10T11:40:44.628559+0000","last_fullsized":"2024-09-10T11:40:44.628559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.627338+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:40:49.627338+0000","last_peered":"2024-09-10T11:40:49.627338+0000","last_clean":"2024-09-10T11:40:49.627338+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:40:49.627338+0000","last_undegraded":"2024-09-10T11:40:49.627338+0000","last_fullsized":"2024-09-10T11:40:49.627338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.621460+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:40:49.621460+0000","last_peered":"2024-09-10T11:40:49.621460+0000","last_clean":"2024-09-10T11:40:49.621460+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:40:49.621460+0000","last_undegraded":"2024-09-10T11:40:49.621460+0000","last_fullsized":"2024-09-10T11:40:49.621460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.620745+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:40:49.620745+0000","last_peered":"2024-09-10T11:40:49.620745+0000","last_clean":"2024-09-10T11:40:49.620745+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:40:49.620745+0000","last_undegraded":"2024-09-10T11:40:49.620745+0000","last_fullsized":"2024-09-10T11:40:49.620745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626053+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:40:49.626053+0000","last_peered":"2024-09-10T11:40:49.626053+0000","last_clean":"2024-09-10T11:40:49.626053+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:40:49.626053+0000","last_undegraded":"2024-09-10T11:40:49.626053+0000","last_fullsized":"2024-09-10T11:40:49.626053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623309+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:40:49.623309+0000","last_peered":"2024-09-10T11:40:49.623309+0000","last_clean":"2024-09-10T11:40:49.623309+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:40:49.623309+0000","last_undegraded":"2024-09-10T11:40:49.623309+0000","last_fullsized":"2024-09-10T11:40:49.623309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626069+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:40:49.626069+0000","last_peered":"2024-09-10T11:40:49.626069+0000","last_clean":"2024-09-10T11:40:49.626069+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:40:49.626069+0000","last_undegraded":"2024-09-10T11:40:49.626069+0000","last_fullsized":"2024-09-10T11:40:49.626069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623833+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:40:54.623833+0000","last_peered":"2024-09-10T11:40:54.623833+0000","last_clean":"2024-09-10T11:40:54.623833+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:40:54.623833+0000","last_undegraded":"2024-09-10T11:40:54.623833+0000","last_fullsized":"2024-09-10T11:40:54.623833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621892+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:40:54.621892+0000","last_peered":"2024-09-10T11:40:54.621892+0000","last_clean":"2024-09-10T11:40:54.621892+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:40:54.621892+0000","last_undegraded":"2024-09-10T11:40:54.621892+0000","last_fullsized":"2024-09-10T11:40:54.621892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628879+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:40:49.628879+0000","last_peered":"2024-09-10T11:40:49.628879+0000","last_clean":"2024-09-10T11:40:49.628879+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:40:49.628879+0000","last_undegraded":"2024-09-10T11:40:49.628879+0000","last_fullsized":"2024-09-10T11:40:49.628879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625564+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:41:09.625564+0000","last_peered":"2024-09-10T11:41:09.625564+0000","last_clean":"2024-09-10T11:41:09.625564+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:41:09.625564+0000","last_undegraded":"2024-09-10T11:41:09.625564+0000","last_fullsized":"2024-09-10T11:41:09.625564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623159+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:41:09.623159+0000","last_peered":"2024-09-10T11:41:09.623159+0000","last_clean":"2024-09-10T11:41:09.623159+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:41:09.623159+0000","last_undegraded":"2024-09-10T11:41:09.623159+0000","last_fullsized":"2024-09-10T11:41:09.623159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625550+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:41:09.625550+0000","last_peered":"2024-09-10T11:41:09.625550+0000","last_clean":"2024-09-10T11:41:09.625550+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:41:09.625550+0000","last_undegraded":"2024-09-10T11:41:09.625550+0000","last_fullsized":"2024-09-10T11:41:09.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623179+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:41:09.623179+0000","last_peered":"2024-09-10T11:41:09.623179+0000","last_clean":"2024-09-10T11:41:09.623179+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:41:09.623179+0000","last_undegraded":"2024-09-10T11:41:09.623179+0000","last_fullsized":"2024-09-10T11:41:09.623179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626847+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:40:44.626847+0000","last_peered":"2024-09-10T11:40:44.626847+0000","last_clean":"2024-09-10T11:40:44.626847+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:40:44.626847+0000","last_undegraded":"2024-09-10T11:40:44.626847+0000","last_fullsized":"2024-09-10T11:40:44.626847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622362+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:40:39.622362+0000","last_peered":"2024-09-10T11:40:39.622362+0000","last_clean":"2024-09-10T11:40:39.622362+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:40:39.622362+0000","last_undegraded":"2024-09-10T11:40:39.622362+0000","last_fullsized":"2024-09-10T11:40:39.622362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622337+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:40:39.622337+0000","last_peered":"2024-09-10T11:40:39.622337+0000","last_clean":"2024-09-10T11:40:39.622337+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:40:39.622337+0000","last_undegraded":"2024-09-10T11:40:39.622337+0000","last_fullsized":"2024-09-10T11:40:39.622337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626866+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:40:44.626866+0000","last_peered":"2024-09-10T11:40:44.626866+0000","last_clean":"2024-09-10T11:40:44.626866+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:40:44.626866+0000","last_undegraded":"2024-09-10T11:40:44.626866+0000","last_fullsized":"2024-09-10T11:40:44.626866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":678737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":87877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":87913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":87787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":249856,"data_stored":87947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":678793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:43:51.308 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T11:43:51.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.464+0000 7f8a91de8640 1 -- 172.21.15.57:0/1413615968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c0731e0 msgr2=0x7f8a8c073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.464+0000 7f8a91de8640 1 --2- 172.21.15.57:0/1413615968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c0731e0 0x7f8a8c073640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009830 tx=0x7f8a8002a5c0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.465+0000 7f8a91de8640 1 -- 172.21.15.57:0/1413615968 shutdown_connections 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.465+0000 7f8a91de8640 1 --2- 172.21.15.57:0/1413615968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c0731e0 0x7f8a8c073640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.465+0000 7f8a91de8640 1 -- 172.21.15.57:0/1413615968 >> 172.21.15.57:0/1413615968 conn(0x7f8a8c0d0a60 msgr2=0x7f8a8c0d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.465+0000 7f8a91de8640 1 -- 172.21.15.57:0/1413615968 shutdown_connections 2024-09-10T11:43:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.465+0000 7f8a91de8640 1 -- 172.21.15.57:0/1413615968 wait complete. 2024-09-10T11:43:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.467+0000 7f8a91de8640 1 Processor -- start 2024-09-10T11:43:51.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.467+0000 7f8a91de8640 1 -- start start 2024-09-10T11:43:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a91de8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 0x7f8a8c1f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a91de8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a8c0731e0 0x7f8a8c154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a91de8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a8c13f1b0 0x7f8a8c15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a91de8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c070790 con 0x7f8a8c13f1b0 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a91de8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c070610 con 0x7f8a8c06fa90 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a91de8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8c070910 con 0x7f8a8c0731e0 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a8b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 0x7f8a8c1f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a8b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 0x7f8a8c1f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58766/0 (socket says 172.21.15.57:58766) 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a8b7fe640 1 -- 172.21.15.57:0/868937509 learned_addr learned my addr 172.21.15.57:0/868937509 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a8bfff640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a8c13f1b0 0x7f8a8c15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.469+0000 7f8a8affd640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a8c0731e0 0x7f8a8c154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8b7fe640 1 -- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a8c0731e0 msgr2=0x7f8a8c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8b7fe640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a8c0731e0 0x7f8a8c154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8b7fe640 1 -- 172.21.15.57:0/868937509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a8c13f1b0 msgr2=0x7f8a8c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8b7fe640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a8c13f1b0 0x7f8a8c15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8b7fe640 1 -- 172.21.15.57:0/868937509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c13fbc0 con 0x7f8a8c06fa90 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8bfff640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a8c13f1b0 0x7f8a8c15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a8b7fe640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 0x7f8a8c1f0cc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c001eb0 tx=0x7f8a7c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011790 con 0x7f8a8c06fa90 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a7c017070 con 0x7f8a8c06fa90 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8c13fea0 con 0x7f8a8c06fa90 2024-09-10T11:43:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011d40 con 0x7f8a8c06fa90 2024-09-10T11:43:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.470+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8c1f07a0 con 0x7f8a8c06fa90 2024-09-10T11:43:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.472+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8c1f02d0 con 0x7f8a8c06fa90 2024-09-10T11:43:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.473+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8a7c01c460 con 0x7f8a8c06fa90 2024-09-10T11:43:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.473+0000 7f8a73fff640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a780750a0 0x7f8a78077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.473+0000 7f8a8affd640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a780750a0 0x7f8a78077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.473+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8a7c096080 con 0x7f8a8c06fa90 2024-09-10T11:43:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.474+0000 7f8a8affd640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a780750a0 0x7f8a78077560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a80034000 tx=0x7f8a80004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:51.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.478+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8a7c05fcb0 con 0x7f8a8c06fa90 2024-09-10T11:43:51.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.667+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a8c073640 con 0x7f8a780750a0 2024-09-10T11:43:51.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.671+0000 7f8a73fff640 1 -- 172.21.15.57:0/868937509 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251818 (secure 0 0 0) 0x7f8a8c073640 con 0x7f8a780750a0 2024-09-10T11:43:51.675 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:51.677 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:43:51.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a780750a0 msgr2=0x7f8a78077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a780750a0 0x7f8a78077560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8a80034000 tx=0x7f8a80004730 comp rx=0 tx=0).stop 2024-09-10T11:43:51.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 msgr2=0x7f8a8c1f0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 0x7f8a8c1f0cc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c001eb0 tx=0x7f8a7c00c820 comp rx=0 tx=0).stop 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 shutdown_connections 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8a780750a0 0x7f8a78077560 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a8c13f1b0 0x7f8a8c15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a8c0731e0 0x7f8a8c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 --2- 172.21.15.57:0/868937509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8c06fa90 0x7f8a8c1f0cc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 >> 172.21.15.57:0/868937509 conn(0x7f8a8c0d0a60 msgr2=0x7f8a8c0d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 shutdown_connections 2024-09-10T11:43:51.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.675+0000 7f8a91de8640 1 -- 172.21.15.57:0/868937509 wait complete. 2024-09-10T11:43:51.691 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T11:43:50.250572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235988,"kb_used_data":3112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738732,"statfs":{"total":773094113280,"available":772852461568,"internally_reserved":0,"allocated":3186688,"data_stored":1887852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.621023+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:40:44.621023+0000","last_peered":"2024-09-10T11:40:44.621023+0000","last_clean":"2024-09-10T11:40:44.621023+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:40:44.621023+0000","last_undegraded":"2024-09-10T11:40:44.621023+0000","last_fullsized":"2024-09-10T11:40:44.621023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625716+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:40:44.625716+0000","last_peered":"2024-09-10T11:40:44.625716+0000","last_clean":"2024-09-10T11:40:44.625716+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:40:44.625716+0000","last_undegraded":"2024-09-10T11:40:44.625716+0000","last_fullsized":"2024-09-10T11:40:44.625716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626827+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:40:44.626827+0000","last_peered":"2024-09-10T11:40:44.626827+0000","last_clean":"2024-09-10T11:40:44.626827+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:40:44.626827+0000","last_undegraded":"2024-09-10T11:40:44.626827+0000","last_fullsized":"2024-09-10T11:40:44.626827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622727+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:40:39.622727+0000","last_peered":"2024-09-10T11:40:39.622727+0000","last_clean":"2024-09-10T11:40:39.622727+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:40:39.622727+0000","last_undegraded":"2024-09-10T11:40:39.622727+0000","last_fullsized":"2024-09-10T11:40:39.622727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623143+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:41:09.623143+0000","last_peered":"2024-09-10T11:41:09.623143+0000","last_clean":"2024-09-10T11:41:09.623143+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:41:09.623143+0000","last_undegraded":"2024-09-10T11:41:09.623143+0000","last_fullsized":"2024-09-10T11:41:09.623143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625526+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:41:09.625526+0000","last_peered":"2024-09-10T11:41:09.625526+0000","last_clean":"2024-09-10T11:41:09.625526+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:41:09.625526+0000","last_undegraded":"2024-09-10T11:41:09.625526+0000","last_fullsized":"2024-09-10T11:41:09.625526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623125+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:41:09.623125+0000","last_peered":"2024-09-10T11:41:09.623125+0000","last_clean":"2024-09-10T11:41:09.623125+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:41:09.623125+0000","last_undegraded":"2024-09-10T11:41:09.623125+0000","last_fullsized":"2024-09-10T11:41:09.623125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625143+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:41:09.625143+0000","last_peered":"2024-09-10T11:41:09.625143+0000","last_clean":"2024-09-10T11:41:09.625143+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:41:09.625143+0000","last_undegraded":"2024-09-10T11:41:09.625143+0000","last_fullsized":"2024-09-10T11:41:09.625143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622777+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:41:04.622777+0000","last_peered":"2024-09-10T11:41:04.622777+0000","last_clean":"2024-09-10T11:41:04.622777+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:41:04.622777+0000","last_undegraded":"2024-09-10T11:41:04.622777+0000","last_fullsized":"2024-09-10T11:41:04.622777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630356+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:41:04.630356+0000","last_peered":"2024-09-10T11:41:04.630356+0000","last_clean":"2024-09-10T11:41:04.630356+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:41:04.630356+0000","last_undegraded":"2024-09-10T11:41:04.630356+0000","last_fullsized":"2024-09-10T11:41:04.630356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630342+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:41:04.630342+0000","last_peered":"2024-09-10T11:41:04.630342+0000","last_clean":"2024-09-10T11:41:04.630342+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:41:04.630342+0000","last_undegraded":"2024-09-10T11:41:04.630342+0000","last_fullsized":"2024-09-10T11:41:04.630342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.621969+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:41:04.621969+0000","last_peered":"2024-09-10T11:41:04.621969+0000","last_clean":"2024-09-10T11:41:04.621969+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:41:04.621969+0000","last_undegraded":"2024-09-10T11:41:04.621969+0000","last_fullsized":"2024-09-10T11:41:04.621969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:39:19.616974+0000","last_change":"2024-09-10T11:39:17.817004+0000","last_active":"2024-09-10T11:39:19.616974+0000","last_peered":"2024-09-10T11:39:19.616974+0000","last_clean":"2024-09-10T11:39:19.616974+0000","last_became_active":"2024-09-10T11:39:17.816727+0000","last_became_peered":"2024-09-10T11:39:17.816727+0000","last_unstale":"2024-09-10T11:39:19.616974+0000","last_undegraded":"2024-09-10T11:39:19.616974+0000","last_fullsized":"2024-09-10T11:39:19.616974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628297+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:40:59.628297+0000","last_peered":"2024-09-10T11:40:59.628297+0000","last_clean":"2024-09-10T11:40:59.628297+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:40:59.628297+0000","last_undegraded":"2024-09-10T11:40:59.628297+0000","last_fullsized":"2024-09-10T11:40:59.628297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.626910+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:40:59.626910+0000","last_peered":"2024-09-10T11:40:59.626910+0000","last_clean":"2024-09-10T11:40:59.626910+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:40:59.626910+0000","last_undegraded":"2024-09-10T11:40:59.626910+0000","last_fullsized":"2024-09-10T11:40:59.626910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624584+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:40:59.624584+0000","last_peered":"2024-09-10T11:40:59.624584+0000","last_clean":"2024-09-10T11:40:59.624584+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:40:59.624584+0000","last_undegraded":"2024-09-10T11:40:59.624584+0000","last_fullsized":"2024-09-10T11:40:59.624584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624632+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:40:59.624632+0000","last_peered":"2024-09-10T11:40:59.624632+0000","last_clean":"2024-09-10T11:40:59.624632+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:40:59.624632+0000","last_undegraded":"2024-09-10T11:40:59.624632+0000","last_fullsized":"2024-09-10T11:40:59.624632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625550+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:40:59.625550+0000","last_peered":"2024-09-10T11:40:59.625550+0000","last_clean":"2024-09-10T11:40:59.625550+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:40:59.625550+0000","last_undegraded":"2024-09-10T11:40:59.625550+0000","last_fullsized":"2024-09-10T11:40:59.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621920+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:40:54.621920+0000","last_peered":"2024-09-10T11:40:54.621920+0000","last_clean":"2024-09-10T11:40:54.621920+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:40:54.621920+0000","last_undegraded":"2024-09-10T11:40:54.621920+0000","last_fullsized":"2024-09-10T11:40:54.621920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629284+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:40:54.629284+0000","last_peered":"2024-09-10T11:40:54.629284+0000","last_clean":"2024-09-10T11:40:54.629284+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:40:54.629284+0000","last_undegraded":"2024-09-10T11:40:54.629284+0000","last_fullsized":"2024-09-10T11:40:54.629284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629142+0000","last_change":"2024-09-10T11:39:17.816383+0000","last_active":"2024-09-10T11:41:34.629142+0000","last_peered":"2024-09-10T11:41:34.629142+0000","last_clean":"2024-09-10T11:41:34.629142+0000","last_became_active":"2024-09-10T11:39:17.816084+0000","last_became_peered":"2024-09-10T11:39:17.816084+0000","last_unstale":"2024-09-10T11:41:34.629142+0000","last_undegraded":"2024-09-10T11:41:34.629142+0000","last_fullsized":"2024-09-10T11:41:34.629142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629050+0000","last_change":"2024-09-10T11:39:17.814534+0000","last_active":"2024-09-10T11:41:34.629050+0000","last_peered":"2024-09-10T11:41:34.629050+0000","last_clean":"2024-09-10T11:41:34.629050+0000","last_became_active":"2024-09-10T11:39:17.814205+0000","last_became_peered":"2024-09-10T11:39:17.814205+0000","last_unstale":"2024-09-10T11:41:34.629050+0000","last_undegraded":"2024-09-10T11:41:34.629050+0000","last_fullsized":"2024-09-10T11:41:34.629050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623787+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:40:54.623787+0000","last_peered":"2024-09-10T11:40:54.623787+0000","last_clean":"2024-09-10T11:40:54.623787+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:40:54.623787+0000","last_undegraded":"2024-09-10T11:40:54.623787+0000","last_fullsized":"2024-09-10T11:40:54.623787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623688+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:40:49.623688+0000","last_peered":"2024-09-10T11:40:49.623688+0000","last_clean":"2024-09-10T11:40:49.623688+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:40:49.623688+0000","last_undegraded":"2024-09-10T11:40:49.623688+0000","last_fullsized":"2024-09-10T11:40:49.623688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623386+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:40:49.623386+0000","last_peered":"2024-09-10T11:40:49.623386+0000","last_clean":"2024-09-10T11:40:49.623386+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:40:49.623386+0000","last_undegraded":"2024-09-10T11:40:49.623386+0000","last_fullsized":"2024-09-10T11:40:49.623386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628912+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:40:49.628912+0000","last_peered":"2024-09-10T11:40:49.628912+0000","last_clean":"2024-09-10T11:40:49.628912+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:40:49.628912+0000","last_undegraded":"2024-09-10T11:40:49.628912+0000","last_fullsized":"2024-09-10T11:40:49.628912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626088+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:40:49.626088+0000","last_peered":"2024-09-10T11:40:49.626088+0000","last_clean":"2024-09-10T11:40:49.626088+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:40:49.626088+0000","last_undegraded":"2024-09-10T11:40:49.626088+0000","last_fullsized":"2024-09-10T11:40:49.626088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623363+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:40:49.623363+0000","last_peered":"2024-09-10T11:40:49.623363+0000","last_clean":"2024-09-10T11:40:49.623363+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:40:49.623363+0000","last_undegraded":"2024-09-10T11:40:49.623363+0000","last_fullsized":"2024-09-10T11:40:49.623363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626811+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:40:44.626811+0000","last_peered":"2024-09-10T11:40:44.626811+0000","last_clean":"2024-09-10T11:40:44.626811+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:40:44.626811+0000","last_undegraded":"2024-09-10T11:40:44.626811+0000","last_fullsized":"2024-09-10T11:40:44.626811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623181+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:40:44.623181+0000","last_peered":"2024-09-10T11:40:44.623181+0000","last_clean":"2024-09-10T11:40:44.623181+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:40:44.623181+0000","last_undegraded":"2024-09-10T11:40:44.623181+0000","last_fullsized":"2024-09-10T11:40:44.623181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624234+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:40:44.624234+0000","last_peered":"2024-09-10T11:40:44.624234+0000","last_clean":"2024-09-10T11:40:44.624234+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:40:44.624234+0000","last_undegraded":"2024-09-10T11:40:44.624234+0000","last_fullsized":"2024-09-10T11:40:44.624234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628530+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:40:44.628530+0000","last_peered":"2024-09-10T11:40:44.628530+0000","last_clean":"2024-09-10T11:40:44.628530+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:40:44.628530+0000","last_undegraded":"2024-09-10T11:40:44.628530+0000","last_fullsized":"2024-09-10T11:40:44.628530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.622330+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:41:09.622330+0000","last_peered":"2024-09-10T11:41:09.622330+0000","last_clean":"2024-09-10T11:41:09.622330+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:41:09.622330+0000","last_undegraded":"2024-09-10T11:41:09.622330+0000","last_fullsized":"2024-09-10T11:41:09.622330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625179+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:41:09.625179+0000","last_peered":"2024-09-10T11:41:09.625179+0000","last_clean":"2024-09-10T11:41:09.625179+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:41:09.625179+0000","last_undegraded":"2024-09-10T11:41:09.625179+0000","last_fullsized":"2024-09-10T11:41:09.625179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.629118+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:41:09.629118+0000","last_peered":"2024-09-10T11:41:09.629118+0000","last_clean":"2024-09-10T11:41:09.629118+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:41:09.629118+0000","last_undegraded":"2024-09-10T11:41:09.629118+0000","last_fullsized":"2024-09-10T11:41:09.629118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630315+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:41:04.630315+0000","last_peered":"2024-09-10T11:41:04.630315+0000","last_clean":"2024-09-10T11:41:04.630315+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:41:04.630315+0000","last_undegraded":"2024-09-10T11:41:04.630315+0000","last_fullsized":"2024-09-10T11:41:04.630315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624745+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:41:04.624745+0000","last_peered":"2024-09-10T11:41:04.624745+0000","last_clean":"2024-09-10T11:41:04.624745+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:41:04.624745+0000","last_undegraded":"2024-09-10T11:41:04.624745+0000","last_fullsized":"2024-09-10T11:41:04.624745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624715+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:41:04.624715+0000","last_peered":"2024-09-10T11:41:04.624715+0000","last_clean":"2024-09-10T11:41:04.624715+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:41:04.624715+0000","last_undegraded":"2024-09-10T11:41:04.624715+0000","last_fullsized":"2024-09-10T11:41:04.624715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625081+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:41:04.625081+0000","last_peered":"2024-09-10T11:41:04.625081+0000","last_clean":"2024-09-10T11:41:04.625081+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:41:04.625081+0000","last_undegraded":"2024-09-10T11:41:04.625081+0000","last_fullsized":"2024-09-10T11:41:04.625081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627391+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:41:04.627391+0000","last_peered":"2024-09-10T11:41:04.627391+0000","last_clean":"2024-09-10T11:41:04.627391+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:41:04.627391+0000","last_undegraded":"2024-09-10T11:41:04.627391+0000","last_fullsized":"2024-09-10T11:41:04.627391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629889+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:40:59.629889+0000","last_peered":"2024-09-10T11:40:59.629889+0000","last_clean":"2024-09-10T11:40:59.629889+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:40:59.629889+0000","last_undegraded":"2024-09-10T11:40:59.629889+0000","last_fullsized":"2024-09-10T11:40:59.629889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625128+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:41:04.625128+0000","last_peered":"2024-09-10T11:41:04.625128+0000","last_clean":"2024-09-10T11:41:04.625128+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:41:04.625128+0000","last_undegraded":"2024-09-10T11:41:04.625128+0000","last_fullsized":"2024-09-10T11:41:04.625128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625143+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:41:04.625143+0000","last_peered":"2024-09-10T11:41:04.625143+0000","last_clean":"2024-09-10T11:41:04.625143+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:41:04.625143+0000","last_undegraded":"2024-09-10T11:41:04.625143+0000","last_fullsized":"2024-09-10T11:41:04.625143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.628725+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:41:04.628725+0000","last_peered":"2024-09-10T11:41:04.628725+0000","last_clean":"2024-09-10T11:41:04.628725+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:41:04.628725+0000","last_undegraded":"2024-09-10T11:41:04.628725+0000","last_fullsized":"2024-09-10T11:41:04.628725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627434+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:41:04.627434+0000","last_peered":"2024-09-10T11:41:04.627434+0000","last_clean":"2024-09-10T11:41:04.627434+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:41:04.627434+0000","last_undegraded":"2024-09-10T11:41:04.627434+0000","last_fullsized":"2024-09-10T11:41:04.627434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.621604+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:40:59.621604+0000","last_peered":"2024-09-10T11:40:59.621604+0000","last_clean":"2024-09-10T11:40:59.621604+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:40:59.621604+0000","last_undegraded":"2024-09-10T11:40:59.621604+0000","last_fullsized":"2024-09-10T11:40:59.621604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629292+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:40:54.629292+0000","last_peered":"2024-09-10T11:40:54.629292+0000","last_clean":"2024-09-10T11:40:54.629292+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:40:54.629292+0000","last_undegraded":"2024-09-10T11:40:54.629292+0000","last_fullsized":"2024-09-10T11:40:54.629292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622743+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:41:04.622743+0000","last_peered":"2024-09-10T11:41:04.622743+0000","last_clean":"2024-09-10T11:41:04.622743+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:41:04.622743+0000","last_undegraded":"2024-09-10T11:41:04.622743+0000","last_fullsized":"2024-09-10T11:41:04.622743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628332+0000","last_change":"2024-09-10T11:38:35.632321+0000","last_active":"2024-09-10T11:40:59.628332+0000","last_peered":"2024-09-10T11:40:59.628332+0000","last_clean":"2024-09-10T11:40:59.628332+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:40:59.628332+0000","last_undegraded":"2024-09-10T11:40:59.628332+0000","last_fullsized":"2024-09-10T11:40:59.628332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:33.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628319+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:40:59.628319+0000","last_peered":"2024-09-10T11:40:59.628319+0000","last_clean":"2024-09-10T11:40:59.628319+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:40:59.628319+0000","last_undegraded":"2024-09-10T11:40:59.628319+0000","last_fullsized":"2024-09-10T11:40:59.628319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624605+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:40:59.624605+0000","last_peered":"2024-09-10T11:40:59.624605+0000","last_clean":"2024-09-10T11:40:59.624605+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:40:59.624605+0000","last_undegraded":"2024-09-10T11:40:59.624605+0000","last_fullsized":"2024-09-10T11:40:59.624605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622311+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:40:59.622311+0000","last_peered":"2024-09-10T11:40:59.622311+0000","last_clean":"2024-09-10T11:40:59.622311+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:40:59.622311+0000","last_undegraded":"2024-09-10T11:40:59.622311+0000","last_fullsized":"2024-09-10T11:40:59.622311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629268+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:40:54.629268+0000","last_peered":"2024-09-10T11:40:54.629268+0000","last_clean":"2024-09-10T11:40:54.629268+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:40:54.629268+0000","last_undegraded":"2024-09-10T11:40:54.629268+0000","last_fullsized":"2024-09-10T11:40:54.629268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629850+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:40:59.629850+0000","last_peered":"2024-09-10T11:40:59.629850+0000","last_clean":"2024-09-10T11:40:59.629850+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:40:59.629850+0000","last_undegraded":"2024-09-10T11:40:59.629850+0000","last_fullsized":"2024-09-10T11:40:59.629850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625504+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:40:59.625504+0000","last_peered":"2024-09-10T11:40:59.625504+0000","last_clean":"2024-09-10T11:40:59.625504+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:40:59.625504+0000","last_undegraded":"2024-09-10T11:40:59.625504+0000","last_fullsized":"2024-09-10T11:40:59.625504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622290+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:40:59.622290+0000","last_peered":"2024-09-10T11:40:59.622290+0000","last_clean":"2024-09-10T11:40:59.622290+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:40:59.622290+0000","last_undegraded":"2024-09-10T11:40:59.622290+0000","last_fullsized":"2024-09-10T11:40:59.622290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621204+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:40:54.621204+0000","last_peered":"2024-09-10T11:40:54.621204+0000","last_clean":"2024-09-10T11:40:54.621204+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:40:54.621204+0000","last_undegraded":"2024-09-10T11:40:54.621204+0000","last_fullsized":"2024-09-10T11:40:54.621204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621928+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:40:54.621928+0000","last_peered":"2024-09-10T11:40:54.621928+0000","last_clean":"2024-09-10T11:40:54.621928+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:40:54.621928+0000","last_undegraded":"2024-09-10T11:40:54.621928+0000","last_fullsized":"2024-09-10T11:40:54.621928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625183+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:40:54.625183+0000","last_peered":"2024-09-10T11:40:54.625183+0000","last_clean":"2024-09-10T11:40:54.625183+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:40:54.625183+0000","last_undegraded":"2024-09-10T11:40:54.625183+0000","last_fullsized":"2024-09-10T11:40:54.625183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621937+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:40:54.621937+0000","last_peered":"2024-09-10T11:40:54.621937+0000","last_clean":"2024-09-10T11:40:54.621937+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:40:54.621937+0000","last_undegraded":"2024-09-10T11:40:54.621937+0000","last_fullsized":"2024-09-10T11:40:54.621937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.626566+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:40:54.626566+0000","last_peered":"2024-09-10T11:40:54.626566+0000","last_clean":"2024-09-10T11:40:54.626566+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:40:54.626566+0000","last_undegraded":"2024-09-10T11:40:54.626566+0000","last_fullsized":"2024-09-10T11:40:54.626566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.624181+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:40:54.624181+0000","last_peered":"2024-09-10T11:40:54.624181+0000","last_clean":"2024-09-10T11:40:54.624181+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:40:54.624181+0000","last_undegraded":"2024-09-10T11:40:54.624181+0000","last_fullsized":"2024-09-10T11:40:54.624181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625163+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:40:54.625163+0000","last_peered":"2024-09-10T11:40:54.625163+0000","last_clean":"2024-09-10T11:40:54.625163+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:40:54.625163+0000","last_undegraded":"2024-09-10T11:40:54.625163+0000","last_fullsized":"2024-09-10T11:40:54.625163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621911+0000","last_change":"2024-09-10T11:39:18.205415+0000","last_active":"2024-09-10T11:40:54.621911+0000","last_peered":"2024-09-10T11:40:54.621911+0000","last_clean":"2024-09-10T11:40:54.621911+0000","last_became_active":"2024-09-10T11:39:18.205081+0000","last_became_peered":"2024-09-10T11:39:18.205081+0000","last_unstale":"2024-09-10T11:40:54.621911+0000","last_undegraded":"2024-09-10T11:40:54.621911+0000","last_fullsized":"2024-09-10T11:40:54.621911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:59:18.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:29.619750+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:40:29.619750+0000","last_peered":"2024-09-10T11:40:29.619750+0000","last_clean":"2024-09-10T11:40:29.619750+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:40:29.619750+0000","last_undegraded":"2024-09-10T11:40:29.619750+0000","last_fullsized":"2024-09-10T11:40:29.619750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623219+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:40:44.623219+0000","last_peered":"2024-09-10T11:40:44.623219+0000","last_clean":"2024-09-10T11:40:44.623219+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:40:44.623219+0000","last_undegraded":"2024-09-10T11:40:44.623219+0000","last_fullsized":"2024-09-10T11:40:44.623219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.622831+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:40:44.622831+0000","last_peered":"2024-09-10T11:40:44.622831+0000","last_clean":"2024-09-10T11:40:44.622831+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:40:44.622831+0000","last_undegraded":"2024-09-10T11:40:44.622831+0000","last_fullsized":"2024-09-10T11:40:44.622831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.620590+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:40:39.620590+0000","last_peered":"2024-09-10T11:40:39.620590+0000","last_clean":"2024-09-10T11:40:39.620590+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:40:39.620590+0000","last_undegraded":"2024-09-10T11:40:39.620590+0000","last_fullsized":"2024-09-10T11:40:39.620590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626782+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:40:44.626782+0000","last_peered":"2024-09-10T11:40:44.626782+0000","last_clean":"2024-09-10T11:40:44.626782+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:40:44.626782+0000","last_undegraded":"2024-09-10T11:40:44.626782+0000","last_fullsized":"2024-09-10T11:40:44.626782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624248+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:40:44.624248+0000","last_peered":"2024-09-10T11:40:44.624248+0000","last_clean":"2024-09-10T11:40:44.624248+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:40:44.624248+0000","last_undegraded":"2024-09-10T11:40:44.624248+0000","last_fullsized":"2024-09-10T11:40:44.624248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.625159+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:40:39.625159+0000","last_peered":"2024-09-10T11:40:39.625159+0000","last_clean":"2024-09-10T11:40:39.625159+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:40:39.625159+0000","last_undegraded":"2024-09-10T11:40:39.625159+0000","last_fullsized":"2024-09-10T11:40:39.625159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623205+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:40:44.623205+0000","last_peered":"2024-09-10T11:40:44.623205+0000","last_clean":"2024-09-10T11:40:44.623205+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:40:44.623205+0000","last_undegraded":"2024-09-10T11:40:44.623205+0000","last_fullsized":"2024-09-10T11:40:44.623205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620398+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:40:44.620398+0000","last_peered":"2024-09-10T11:40:44.620398+0000","last_clean":"2024-09-10T11:40:44.620398+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:40:44.620398+0000","last_undegraded":"2024-09-10T11:40:44.620398+0000","last_fullsized":"2024-09-10T11:40:44.620398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625693+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:40:44.625693+0000","last_peered":"2024-09-10T11:40:44.625693+0000","last_clean":"2024-09-10T11:40:44.625693+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:40:44.625693+0000","last_undegraded":"2024-09-10T11:40:44.625693+0000","last_fullsized":"2024-09-10T11:40:44.625693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623247+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:40:44.623247+0000","last_peered":"2024-09-10T11:40:44.623247+0000","last_clean":"2024-09-10T11:40:44.623247+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:40:44.623247+0000","last_undegraded":"2024-09-10T11:40:44.623247+0000","last_fullsized":"2024-09-10T11:40:44.623247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620999+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:40:44.620999+0000","last_peered":"2024-09-10T11:40:44.620999+0000","last_clean":"2024-09-10T11:40:44.620999+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:40:44.620999+0000","last_undegraded":"2024-09-10T11:40:44.620999+0000","last_fullsized":"2024-09-10T11:40:44.620999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625670+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:40:44.625670+0000","last_peered":"2024-09-10T11:40:44.625670+0000","last_clean":"2024-09-10T11:40:44.625670+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:40:44.625670+0000","last_undegraded":"2024-09-10T11:40:44.625670+0000","last_fullsized":"2024-09-10T11:40:44.625670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626109+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:40:49.626109+0000","last_peered":"2024-09-10T11:40:49.626109+0000","last_clean":"2024-09-10T11:40:49.626109+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:40:49.626109+0000","last_undegraded":"2024-09-10T11:40:49.626109+0000","last_fullsized":"2024-09-10T11:40:49.626109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623400+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:40:49.623400+0000","last_peered":"2024-09-10T11:40:49.623400+0000","last_clean":"2024-09-10T11:40:49.623400+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:40:49.623400+0000","last_undegraded":"2024-09-10T11:40:49.623400+0000","last_fullsized":"2024-09-10T11:40:49.623400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628559+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:40:44.628559+0000","last_peered":"2024-09-10T11:40:44.628559+0000","last_clean":"2024-09-10T11:40:44.628559+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:40:44.628559+0000","last_undegraded":"2024-09-10T11:40:44.628559+0000","last_fullsized":"2024-09-10T11:40:44.628559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.627338+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:40:49.627338+0000","last_peered":"2024-09-10T11:40:49.627338+0000","last_clean":"2024-09-10T11:40:49.627338+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:40:49.627338+0000","last_undegraded":"2024-09-10T11:40:49.627338+0000","last_fullsized":"2024-09-10T11:40:49.627338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.621460+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:40:49.621460+0000","last_peered":"2024-09-10T11:40:49.621460+0000","last_clean":"2024-09-10T11:40:49.621460+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:40:49.621460+0000","last_undegraded":"2024-09-10T11:40:49.621460+0000","last_fullsized":"2024-09-10T11:40:49.621460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.620745+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:40:49.620745+0000","last_peered":"2024-09-10T11:40:49.620745+0000","last_clean":"2024-09-10T11:40:49.620745+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:40:49.620745+0000","last_undegraded":"2024-09-10T11:40:49.620745+0000","last_fullsized":"2024-09-10T11:40:49.620745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626053+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:40:49.626053+0000","last_peered":"2024-09-10T11:40:49.626053+0000","last_clean":"2024-09-10T11:40:49.626053+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:40:49.626053+0000","last_undegraded":"2024-09-10T11:40:49.626053+0000","last_fullsized":"2024-09-10T11:40:49.626053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623309+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:40:49.623309+0000","last_peered":"2024-09-10T11:40:49.623309+0000","last_clean":"2024-09-10T11:40:49.623309+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:40:49.623309+0000","last_undegraded":"2024-09-10T11:40:49.623309+0000","last_fullsized":"2024-09-10T11:40:49.623309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626069+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:40:49.626069+0000","last_peered":"2024-09-10T11:40:49.626069+0000","last_clean":"2024-09-10T11:40:49.626069+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:40:49.626069+0000","last_undegraded":"2024-09-10T11:40:49.626069+0000","last_fullsized":"2024-09-10T11:40:49.626069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623833+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:40:54.623833+0000","last_peered":"2024-09-10T11:40:54.623833+0000","last_clean":"2024-09-10T11:40:54.623833+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:40:54.623833+0000","last_undegraded":"2024-09-10T11:40:54.623833+0000","last_fullsized":"2024-09-10T11:40:54.623833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621892+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:40:54.621892+0000","last_peered":"2024-09-10T11:40:54.621892+0000","last_clean":"2024-09-10T11:40:54.621892+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:40:54.621892+0000","last_undegraded":"2024-09-10T11:40:54.621892+0000","last_fullsized":"2024-09-10T11:40:54.621892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628879+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:40:49.628879+0000","last_peered":"2024-09-10T11:40:49.628879+0000","last_clean":"2024-09-10T11:40:49.628879+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:40:49.628879+0000","last_undegraded":"2024-09-10T11:40:49.628879+0000","last_fullsized":"2024-09-10T11:40:49.628879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625564+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:41:09.625564+0000","last_peered":"2024-09-10T11:41:09.625564+0000","last_clean":"2024-09-10T11:41:09.625564+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:41:09.625564+0000","last_undegraded":"2024-09-10T11:41:09.625564+0000","last_fullsized":"2024-09-10T11:41:09.625564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623159+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:41:09.623159+0000","last_peered":"2024-09-10T11:41:09.623159+0000","last_clean":"2024-09-10T11:41:09.623159+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:41:09.623159+0000","last_undegraded":"2024-09-10T11:41:09.623159+0000","last_fullsized":"2024-09-10T11:41:09.623159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625550+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:41:09.625550+0000","last_peered":"2024-09-10T11:41:09.625550+0000","last_clean":"2024-09-10T11:41:09.625550+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:41:09.625550+0000","last_undegraded":"2024-09-10T11:41:09.625550+0000","last_fullsized":"2024-09-10T11:41:09.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623179+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:41:09.623179+0000","last_peered":"2024-09-10T11:41:09.623179+0000","last_clean":"2024-09-10T11:41:09.623179+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:41:09.623179+0000","last_undegraded":"2024-09-10T11:41:09.623179+0000","last_fullsized":"2024-09-10T11:41:09.623179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626847+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:40:44.626847+0000","last_peered":"2024-09-10T11:40:44.626847+0000","last_clean":"2024-09-10T11:40:44.626847+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:40:44.626847+0000","last_undegraded":"2024-09-10T11:40:44.626847+0000","last_fullsized":"2024-09-10T11:40:44.626847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622362+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:40:39.622362+0000","last_peered":"2024-09-10T11:40:39.622362+0000","last_clean":"2024-09-10T11:40:39.622362+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:40:39.622362+0000","last_undegraded":"2024-09-10T11:40:39.622362+0000","last_fullsized":"2024-09-10T11:40:39.622362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622337+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:40:39.622337+0000","last_peered":"2024-09-10T11:40:39.622337+0000","last_clean":"2024-09-10T11:40:39.622337+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:40:39.622337+0000","last_undegraded":"2024-09-10T11:40:39.622337+0000","last_fullsized":"2024-09-10T11:40:39.622337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626866+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:40:44.626866+0000","last_peered":"2024-09-10T11:40:44.626866+0000","last_clean":"2024-09-10T11:40:44.626866+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:40:44.626866+0000","last_undegraded":"2024-09-10T11:40:44.626866+0000","last_fullsized":"2024-09-10T11:40:44.626866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":678737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":87877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":87913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":87787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":249856,"data_stored":87947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":678793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:43:51.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T11:43:51.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 -- 172.21.15.57:0/766327734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 msgr2=0x7f23100cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 --2- 172.21.15.57:0/766327734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23100cef50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2308005fd0 tx=0x7f230802a7a0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 -- 172.21.15.57:0/766327734 shutdown_connections 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 --2- 172.21.15.57:0/766327734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23100cef50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 --2- 172.21.15.57:0/766327734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 0x7f23100d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 -- 172.21.15.57:0/766327734 >> 172.21.15.57:0/766327734 conn(0x7f231009cfe0 msgr2=0x7f23100d3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 -- 172.21.15.57:0/766327734 shutdown_connections 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.869+0000 7f231611e640 1 -- 172.21.15.57:0/766327734 wait complete. 2024-09-10T11:43:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.871+0000 7f231611e640 1 Processor -- start 2024-09-10T11:43:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.871+0000 7f231611e640 1 -- start start 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f231611e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 0x7f23100cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f231611e640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23101f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f231611e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23101612a0 0x7f231015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f231611e640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f23100b3690 con 0x7f23100d4820 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f231611e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23100b3510 con 0x7f23101612a0 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f231611e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f23100b3810 con 0x7f23100b49a0 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23101f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 0x7f23100cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23101f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38868/0 (socket says 172.21.15.57:38868) 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 -- 172.21.15.57:0/4155527012 learned_addr learned my addr 172.21.15.57:0/4155527012 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230ffff640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23101612a0 0x7f231015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 -- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 msgr2=0x7f23100cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 0x7f23100cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 -- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23101612a0 msgr2=0x7f231015d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23101612a0 0x7f231015d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230effd640 1 -- 172.21.15.57:0/4155527012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23101f4ff0 con 0x7f23100d4820 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230f7fe640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 0x7f23100cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.872+0000 7f230ffff640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23101612a0 0x7f231015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.873+0000 7f230effd640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23101f4700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f230400ea20 tx=0x7f230400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.873+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230400cd20 con 0x7f23100d4820 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.873+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2304010430 con 0x7f23100d4820 2024-09-10T11:43:51.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.873+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23101f52d0 con 0x7f23100d4820 2024-09-10T11:43:51.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.873+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23040107e0 con 0x7f23100d4820 2024-09-10T11:43:51.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.873+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23100c7be0 con 0x7f23100d4820 2024-09-10T11:43:51.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.874+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2304010980 con 0x7f23100d4820 2024-09-10T11:43:51.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.875+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23100d1900 con 0x7f23100d4820 2024-09-10T11:43:51.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.875+0000 7f22f7fff640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f22fc0750a0 0x7f22fc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:51.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.875+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2304096ea0 con 0x7f23100d4820 2024-09-10T11:43:51.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.875+0000 7f230f7fe640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f22fc0750a0 0x7f22fc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:51.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.876+0000 7f230f7fe640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f22fc0750a0 0x7f22fc077560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2300000f60 tx=0x7f2300009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:51.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:51.884+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2304060ab0 con 0x7f23100d4820 2024-09-10T11:43:52.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.151+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23101f54a0 con 0x7f23100d4820 2024-09-10T11:43:52.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.152+0000 7f22f7fff640 1 -- 172.21.15.57:0/4155527012 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16926 (secure 0 0 0) 0x7f2304065270 con 0x7f23100d4820 2024-09-10T11:43:52.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:52.154 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"7a594499-0d72-4dbb-a3a3-20517d473caf","created":"2024-09-10T11:38:11.562909+0000","modified":"2024-09-10T11:39:17.800061+0000","last_up_change":"2024-09-10T11:38:24.470260+0000","last_in_change":"2024-09-10T11:38:14.590913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T11:38:26.204889+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T11:38:33.708684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T11:38:34.920262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"317ac81b-9740-4cd4-bfa8-924e88ee3d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6825","nonce":2685346277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6827","nonce":2685346277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6831","nonce":2685346277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":2685346277},{"type":"v1","addr":"172.21.15.57:6829","nonce":2685346277}]},"public_addr":"172.21.15.57:6825/2685346277","cluster_addr":"172.21.15.57:6827/2685346277","heartbeat_back_addr":"172.21.15.57:6831/2685346277","heartbeat_front_addr":"172.21.15.57:6829/2685346277","state":["exists","up"]},{"osd":1,"uuid":"6ddc1847-fef4-448a-8222-528cee0fe3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6809","nonce":1756241264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6811","nonce":1756241264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6815","nonce":1756241264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":1756241264},{"type":"v1","addr":"172.21.15.57:6813","nonce":1756241264}]},"public_addr":"172.21.15.57:6809/1756241264","cluster_addr":"172.21.15.57:6811/1756241264","heartbeat_back_addr":"172.21.15.57:6815/1756241264","heartbeat_front_addr":"172.21.15.57:6813/1756241264","state":["exists","up"]},{"osd":2,"uuid":"dd781c85-161f-4605-aa0c-bee88f13f236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6817","nonce":292362606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6819","nonce":292362606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6823","nonce":292362606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":292362606},{"type":"v1","addr":"172.21.15.57:6821","nonce":292362606}]},"public_addr":"172.21.15.57:6817/292362606","cluster_addr":"172.21.15.57:6819/292362606","heartbeat_back_addr":"172.21.15.57:6823/292362606","heartbeat_front_addr":"172.21.15.57:6821/292362606","state":["exists","up"]},{"osd":3,"uuid":"630caf47-2b92-445f-ac9b-8bb106572602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6801","nonce":2364480318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6803","nonce":2364480318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6807","nonce":2364480318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2364480318},{"type":"v1","addr":"172.21.15.57:6805","nonce":2364480318}]},"public_addr":"172.21.15.57:6801/2364480318","cluster_addr":"172.21.15.57:6803/2364480318","heartbeat_back_addr":"172.21.15.57:6807/2364480318","heartbeat_front_addr":"172.21.15.57:6805/2364480318","state":["exists","up"]},{"osd":4,"uuid":"1719d3e3-0400-40cb-a07e-571586f93917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6801","nonce":3245795650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6803","nonce":3245795650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6807","nonce":3245795650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3245795650},{"type":"v1","addr":"172.21.15.154:6805","nonce":3245795650}]},"public_addr":"172.21.15.154:6801/3245795650","cluster_addr":"172.21.15.154:6803/3245795650","heartbeat_back_addr":"172.21.15.154:6807/3245795650","heartbeat_front_addr":"172.21.15.154:6805/3245795650","state":["exists","up"]},{"osd":5,"uuid":"c073452c-dd49-409f-84d9-6c82677dd8dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6827","nonce":4034291138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6829","nonce":4034291138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6833","nonce":4034291138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4034291138},{"type":"v1","addr":"172.21.15.154:6831","nonce":4034291138}]},"public_addr":"172.21.15.154:6827/4034291138","cluster_addr":"172.21.15.154:6829/4034291138","heartbeat_back_addr":"172.21.15.154:6833/4034291138","heartbeat_front_addr":"172.21.15.154:6831/4034291138","state":["exists","up"]},{"osd":6,"uuid":"3f045575-8039-4ab3-ac23-43c062dd06d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6819","nonce":2363284508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6821","nonce":2363284508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6825","nonce":2363284508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2363284508},{"type":"v1","addr":"172.21.15.154:6823","nonce":2363284508}]},"public_addr":"172.21.15.154:6819/2363284508","cluster_addr":"172.21.15.154:6821/2363284508","heartbeat_back_addr":"172.21.15.154:6825/2363284508","heartbeat_front_addr":"172.21.15.154:6823/2363284508","state":["exists","up"]},{"osd":7,"uuid":"f9f4fbaf-9067-44eb-9a0a-546ac2febd90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6809","nonce":2303779163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6811","nonce":2303779163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6815","nonce":2303779163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2303779163},{"type":"v1","addr":"172.21.15.154:6813","nonce":2303779163}]},"public_addr":"172.21.15.154:6809/2303779163","cluster_addr":"172.21.15.154:6811/2303779163","heartbeat_back_addr":"172.21.15.154:6815/2303779163","heartbeat_front_addr":"172.21.15.154:6813/2303779163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.140087+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.200912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.144160+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.902436+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.899318+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.228595+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:21.535517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T11:38:20.674816+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T11:43:52.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f22fc0750a0 msgr2=0x7f22fc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:52.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f22fc0750a0 0x7f22fc077560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2300000f60 tx=0x7f2300009040 comp rx=0 tx=0).stop 2024-09-10T11:43:52.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 msgr2=0x7f23101f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:52.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23101f4700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f230400ea20 tx=0x7f230400eee0 comp rx=0 tx=0).stop 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 shutdown_connections 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f22fc0750a0 0x7f22fc077560 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23101612a0 0x7f231015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23100d4820 0x7f23101f4700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 --2- 172.21.15.57:0/4155527012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23100b49a0 0x7f23100cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 >> 172.21.15.57:0/4155527012 conn(0x7f231009cfe0 msgr2=0x7f23100b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 shutdown_connections 2024-09-10T11:43:52.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:52.154+0000 7f231611e640 1 -- 172.21.15.57:0/4155527012 wait complete. 2024-09-10T11:43:53.171 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T11:43:53.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:53.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 -- 172.21.15.57:0/2111155504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb940d4b50 msgr2=0x7fbb941619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 --2- 172.21.15.57:0/2111155504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb940d4b50 0x7fbb941619d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb88005fd0 tx=0x7fbb8802a610 comp rx=0 tx=0).stop 2024-09-10T11:43:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 -- 172.21.15.57:0/2111155504 shutdown_connections 2024-09-10T11:43:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 --2- 172.21.15.57:0/2111155504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb940d4b50 0x7fbb941619d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 -- 172.21.15.57:0/2111155504 >> 172.21.15.57:0/2111155504 conn(0x7fbb940d3e70 msgr2=0x7fbb940d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 -- 172.21.15.57:0/2111155504 shutdown_connections 2024-09-10T11:43:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.334+0000 7fbb990c6640 1 -- 172.21.15.57:0/2111155504 wait complete. 2024-09-10T11:43:53.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.336+0000 7fbb990c6640 1 Processor -- start 2024-09-10T11:43:53.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.336+0000 7fbb990c6640 1 -- start start 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb990c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb940cfae0 0x7fbb9415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb990c6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb940d4b50 0x7fbb940cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb990c6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9415df60 0x7fbb940c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb990c6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9415ede0 con 0x7fbb9415df60 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb990c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9415ec60 con 0x7fbb940cfae0 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb990c6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9415ef60 con 0x7fbb940d4b50 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb940d4b50 0x7fbb940cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb92d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb940cfae0 0x7fbb9415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb940d4b50 0x7fbb940cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:54298/0 (socket says 172.21.15.57:54298) 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9259c640 1 -- 172.21.15.57:0/2727531505 learned_addr learned my addr 172.21.15.57:0/2727531505 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9359e640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9415df60 0x7fbb940c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9359e640 1 -- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb940d4b50 msgr2=0x7fbb940cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9359e640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb940d4b50 0x7fbb940cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9359e640 1 -- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb940cfae0 msgr2=0x7fbb9415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9359e640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb940cfae0 0x7fbb9415c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb9359e640 1 -- 172.21.15.57:0/2727531505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb940c8a50 con 0x7fbb9415df60 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.337+0000 7fbb92d9d640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb940cfae0 0x7fbb9415c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.338+0000 7fbb9359e640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9415df60 0x7fbb940c9bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb9408d1f0 tx=0x7fbb8c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.338+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c017070 con 0x7fbb9415df60 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.338+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb8c005070 con 0x7fbb9415df60 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.338+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb940c8d30 con 0x7fbb9415df60 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.338+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0054c0 con 0x7fbb9415df60 2024-09-10T11:43:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.338+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb940c92f0 con 0x7fbb9415df60 2024-09-10T11:43:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.339+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb940c96d0 con 0x7fbb9415df60 2024-09-10T11:43:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.340+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fbb8c01a070 con 0x7fbb9415df60 2024-09-10T11:43:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb7b7fe640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbb800750d0 0x7fbb80077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fbb8c095af0 con 0x7fbb9415df60 2024-09-10T11:43:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb92d9d640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbb800750d0 0x7fbb80077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb7b7fe640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fbb8007d3f0 0x7fbb8007f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 --> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb8c00de50 con 0x7fbb8007d3f0 2024-09-10T11:43:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fbb8c09a2a0 con 0x7fbb9415df60 2024-09-10T11:43:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb9259c640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fbb8007d3f0 0x7fbb8007f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.341+0000 7fbb92d9d640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbb800750d0 0x7fbb80077590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb84000f60 tx=0x7fbb84009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.342+0000 7fbb9259c640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fbb8007d3f0 0x7fbb8007f870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.342+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== osd.0 v2:172.21.15.57:6824/2685346277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb8c00de50 con 0x7fbb8007d3f0 2024-09-10T11:43:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.368+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 --> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb941619d0 con 0x7fbb8007d3f0 2024-09-10T11:43:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.368+0000 7fbb7b7fe640 1 -- 172.21.15.57:0/2727531505 <== osd.0 v2:172.21.15.57:6824/2685346277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb941619d0 con 0x7fbb8007d3f0 2024-09-10T11:43:53.370 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:53.371 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fbb8007d3f0 msgr2=0x7fbb8007f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:6824/2685346277,v1:172.21.15.57:6825/2685346277] conn(0x7fbb8007d3f0 0x7fbb8007f870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbb800750d0 msgr2=0x7fbb80077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbb800750d0 0x7fbb80077590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb84000f60 tx=0x7fbb84009040 comp rx=0 tx=0).stop 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9415df60 msgr2=0x7fbb940c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 --2- 172.21.15.57:0/2727531505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9415df60 0x7fbb940c9bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb9408d1f0 tx=0x7fbb8c00ccd0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb9359e640 1 -- 172.21.15.57:0/2727531505 reap_dead start 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 shutdown_connections 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 >> 172.21.15.57:0/2727531505 conn(0x7fbb940d3e70 msgr2=0x7fbb940b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 shutdown_connections 2024-09-10T11:43:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.369+0000 7fbb990c6640 1 -- 172.21.15.57:0/2727531505 wait complete. 2024-09-10T11:43:53.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T11:43:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1291725996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9815bc80 msgr2=0x7f5e980d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1291725996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9815bc80 0x7f5e980d01c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e94005fd0 tx=0x7f5e9402a670 comp rx=0 tx=0).stop 2024-09-10T11:43:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1291725996 shutdown_connections 2024-09-10T11:43:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1291725996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e980d2120 0x7f5e980afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1291725996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e9815bc80 0x7f5e980d01c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1291725996 >> 172.21.15.57:0/1291725996 conn(0x7f5e9809aa20 msgr2=0x7f5e9809ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1291725996 shutdown_connections 2024-09-10T11:43:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.518+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1291725996 wait complete. 2024-09-10T11:43:53.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.520+0000 7f5e9f5aa640 1 Processor -- start 2024-09-10T11:43:53.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.520+0000 7f5e9f5aa640 1 -- start start 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9f5aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 0x7f5e981ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9f5aa640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980d2120 0x7f5e9806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9f5aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e9815bc80 0x7f5e981f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9f5aa640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980b0780 con 0x7f5e980d2120 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9f5aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980b0600 con 0x7f5e980d0700 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9f5aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5e980b0900 con 0x7f5e9815bc80 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 0x7f5e981ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 0x7f5e981ee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58784/0 (socket says 172.21.15.57:58784) 2024-09-10T11:43:53.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 -- 172.21.15.57:0/1802226229 learned_addr learned my addr 172.21.15.57:0/1802226229 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9db47640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e9815bc80 0x7f5e981f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9cb45640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980d2120 0x7f5e9806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 -- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e9815bc80 msgr2=0x7f5e981f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e9815bc80 0x7f5e981f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 -- 172.21.15.57:0/1802226229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980d2120 msgr2=0x7f5e9806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980d2120 0x7f5e9806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 -- 172.21.15.57:0/1802226229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e981eedf0 con 0x7f5e980d0700 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9cb45640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980d2120 0x7f5e9806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.522+0000 7f5e9d346640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 0x7f5e981ee8b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5e94034040 tx=0x7f5e940038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.523+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9403e030 con 0x7f5e980d0700 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.523+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e94003db0 con 0x7f5e980d0700 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.523+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e980cb670 con 0x7f5e980d0700 2024-09-10T11:43:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.523+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94035040 con 0x7f5e980d0700 2024-09-10T11:43:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.524+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9815daa0 con 0x7f5e980d0700 2024-09-10T11:43:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.525+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9815d890 con 0x7f5e980d0700 2024-09-10T11:43:53.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.526+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f5e94041030 con 0x7f5e980d0700 2024-09-10T11:43:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.526+0000 7f5e8dffb640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5e7c0750a0 0x7f5e7c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.526+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5e940b6850 con 0x7f5e980d0700 2024-09-10T11:43:53.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.527+0000 7f5e9cb45640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5e7c0750a0 0x7f5e7c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.527+0000 7f5e9cb45640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5e7c0750a0 0x7f5e7c077560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e980b1100 tx=0x7f5e88009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.531+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f5e94080570 con 0x7f5e980d0700 2024-09-10T11:43:53.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.742+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5e980b0db0 con 0x7f5e7c0750a0 2024-09-10T11:43:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.743+0000 7f5e8dffb640 1 -- 172.21.15.57:0/1802226229 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e980b0db0 con 0x7f5e7c0750a0 2024-09-10T11:43:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5e7c0750a0 msgr2=0x7f5e7c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5e7c0750a0 0x7f5e7c077560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e980b1100 tx=0x7f5e88009040 comp rx=0 tx=0).stop 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 msgr2=0x7f5e981ee8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 0x7f5e981ee8b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5e94034040 tx=0x7f5e940038a0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 shutdown_connections 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f5e7c0750a0 0x7f5e7c077560 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e9815bc80 0x7f5e981f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e980d2120 0x7f5e9806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 --2- 172.21.15.57:0/1802226229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e980d0700 0x7f5e981ee8b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 >> 172.21.15.57:0/1802226229 conn(0x7f5e9809aa20 msgr2=0x7f5e980ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:53.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 shutdown_connections 2024-09-10T11:43:53.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.746+0000 7f5e9f5aa640 1 -- 172.21.15.57:0/1802226229 wait complete. 2024-09-10T11:43:53.760 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T11:43:53.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 -- 172.21.15.57:0/764129774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa30015df60 msgr2=0x7fa3000d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 --2- 172.21.15.57:0/764129774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa30015df60 0x7fa3000d0fc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005fd0 tx=0x7fa2f002a670 comp rx=0 tx=0).stop 2024-09-10T11:43:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 -- 172.21.15.57:0/764129774 shutdown_connections 2024-09-10T11:43:53.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 --2- 172.21.15.57:0/764129774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3000d4b50 0x7fa3001619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 --2- 172.21.15.57:0/764129774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa30015df60 0x7fa3000d0fc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 -- 172.21.15.57:0/764129774 >> 172.21.15.57:0/764129774 conn(0x7fa3000d3e70 msgr2=0x7fa3000d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:53.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 -- 172.21.15.57:0/764129774 shutdown_connections 2024-09-10T11:43:53.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.913+0000 7fa30480f640 1 -- 172.21.15.57:0/764129774 wait complete. 2024-09-10T11:43:53.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.914+0000 7fa30480f640 1 Processor -- start 2024-09-10T11:43:53.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.914+0000 7fa30480f640 1 -- start start 2024-09-10T11:43:53.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa30480f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3000cfae0 0x7fa30015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa30480f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3000d4b50 0x7fa3000ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa30480f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30015df60 0x7fa30015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa30480f640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa3000d2150 con 0x7fa3000cfae0 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa30480f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa300162310 con 0x7fa3000d4b50 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa2fe59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3000cfae0 0x7fa30015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa30480f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa3000d22d0 con 0x7fa30015df60 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa2fdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3000d4b50 0x7fa3000ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa2fed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30015df60 0x7fa30015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa2fdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3000d4b50 0x7fa3000ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58798/0 (socket says 172.21.15.57:58798) 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.915+0000 7fa2fdd9b640 1 -- 172.21.15.57:0/257834403 learned_addr learned my addr 172.21.15.57:0/257834403 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2fdd9b640 1 -- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30015df60 msgr2=0x7fa30015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2fdd9b640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30015df60 0x7fa30015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2fdd9b640 1 -- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3000cfae0 msgr2=0x7fa30015a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2fdd9b640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3000cfae0 0x7fa30015a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2fdd9b640 1 -- 172.21.15.57:0/257834403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3000b8150 con 0x7fa3000d4b50 2024-09-10T11:43:53.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2fdd9b640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3000d4b50 0x7fa3000ca290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400e9f0 tx=0x7fa2f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400ccc0 con 0x7fa3000d4b50 2024-09-10T11:43:53.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2f4004020 con 0x7fa3000d4b50 2024-09-10T11:43:53.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3000b8990 con 0x7fa3000d4b50 2024-09-10T11:43:53.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f400ce60 con 0x7fa3000d4b50 2024-09-10T11:43:53.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.916+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3000b8f50 con 0x7fa3000d4b50 2024-09-10T11:43:53.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.917+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3000b9610 con 0x7fa3000d4b50 2024-09-10T11:43:53.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.918+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa2f40035f0 con 0x7fa3000d4b50 2024-09-10T11:43:53.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.918+0000 7fa2eeffd640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e00750a0 0x7fa2e0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa2f4096d20 con 0x7fa3000d4b50 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2fe59c640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e00750a0 0x7fa2e0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2eeffd640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7fa2e007d3c0 0x7fa2e007f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 --> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2f400be50 con 0x7fa2e007d3c0 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa2f40993c0 con 0x7fa3000d4b50 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2fed9d640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7fa2e007d3c0 0x7fa2e007f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2fe59c640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e00750a0 0x7fa2e0077560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0033000 tx=0x7fa2f0004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.919+0000 7fa2fed9d640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7fa2e007d3c0 0x7fa2e007f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:53.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.920+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== osd.1 v2:172.21.15.57:6808/1756241264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2f400be50 con 0x7fa2e007d3c0 2024-09-10T11:43:53.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.941+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 --> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa3000d2780 con 0x7fa2e007d3c0 2024-09-10T11:43:53.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.941+0000 7fa2eeffd640 1 -- 172.21.15.57:0/257834403 <== osd.1 v2:172.21.15.57:6808/1756241264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa3000d2780 con 0x7fa2e007d3c0 2024-09-10T11:43:53.943 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:53.943 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:53.943 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.941+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7fa2e007d3c0 msgr2=0x7fa2e007f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.941+0000 7fa30480f640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.57:6808/1756241264,v1:172.21.15.57:6809/1756241264] conn(0x7fa2e007d3c0 0x7fa2e007f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e00750a0 msgr2=0x7fa2e0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e00750a0 0x7fa2e0077560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0033000 tx=0x7fa2f0004730 comp rx=0 tx=0).stop 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3000d4b50 msgr2=0x7fa3000ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 --2- 172.21.15.57:0/257834403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3000d4b50 0x7fa3000ca290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400e9f0 tx=0x7fa2f400eeb0 comp rx=0 tx=0).stop 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa2fed9d640 1 -- 172.21.15.57:0/257834403 reap_dead start 2024-09-10T11:43:53.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 shutdown_connections 2024-09-10T11:43:53.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 >> 172.21.15.57:0/257834403 conn(0x7fa3000d3e70 msgr2=0x7fa3000d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:53.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 shutdown_connections 2024-09-10T11:43:53.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:53.942+0000 7fa30480f640 1 -- 172.21.15.57:0/257834403 wait complete. 2024-09-10T11:43:53.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.083+0000 7f0629ea2640 1 -- 172.21.15.57:0/3948565327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f062415dbf0 msgr2=0x7f06240d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.083+0000 7f0629ea2640 1 --2- 172.21.15.57:0/3948565327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f062415dbf0 0x7f06240d10d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0614005fd0 tx=0x7f061402a5d0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.083+0000 7f0629ea2640 1 -- 172.21.15.57:0/3948565327 shutdown_connections 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.083+0000 7f0629ea2640 1 --2- 172.21.15.57:0/3948565327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f062415dbf0 0x7f06240d10d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.083+0000 7f0629ea2640 1 -- 172.21.15.57:0/3948565327 >> 172.21.15.57:0/3948565327 conn(0x7f062408d6d0 msgr2=0x7f062409cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.083+0000 7f0629ea2640 1 -- 172.21.15.57:0/3948565327 shutdown_connections 2024-09-10T11:43:54.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.084+0000 7f0629ea2640 1 -- 172.21.15.57:0/3948565327 wait complete. 2024-09-10T11:43:54.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.085+0000 7f0629ea2640 1 Processor -- start 2024-09-10T11:43:54.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.085+0000 7f0629ea2640 1 -- start start 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0629ea2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 0x7f06241f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0629ea2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06240d4130 0x7f06241f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0629ea2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f062415dbf0 0x7f06240ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0629ea2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06240cf4b0 con 0x7f06240d1940 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0629ea2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06240cf330 con 0x7f06240d4130 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0629ea2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f06240cf630 con 0x7f062415dbf0 2024-09-10T11:43:54.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f06237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 0x7f06241f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0622ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06240d4130 0x7f06241f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f06237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 0x7f06241f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38938/0 (socket says 172.21.15.57:38938) 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f06237fe640 1 -- 172.21.15.57:0/2300232351 learned_addr learned my addr 172.21.15.57:0/2300232351 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.086+0000 7f0623fff640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f062415dbf0 0x7f06240ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f06237fe640 1 -- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f062415dbf0 msgr2=0x7f06240ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f06237fe640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f062415dbf0 0x7f06240ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f06237fe640 1 -- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06240d4130 msgr2=0x7f06241f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f06237fe640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06240d4130 0x7f06241f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f06237fe640 1 -- 172.21.15.57:0/2300232351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062415e310 con 0x7f06240d1940 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f0622ffd640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06240d4130 0x7f06241f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f06237fe640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 0x7f06241f5850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0614009850 tx=0x7f06140035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061403f070 con 0x7f06240d1940 2024-09-10T11:43:54.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062415e5b0 con 0x7f06240d1940 2024-09-10T11:43:54.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0614003ce0 con 0x7f06240d1940 2024-09-10T11:43:54.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614035030 con 0x7f06240d1940 2024-09-10T11:43:54.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.087+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062415eb70 con 0x7f06240d1940 2024-09-10T11:43:54.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.088+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06240cfbc0 con 0x7f06240d1940 2024-09-10T11:43:54.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.089+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f0614042070 con 0x7f06240d1940 2024-09-10T11:43:54.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.090+0000 7f060bfff640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06100750a0 0x7f0610077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.090+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f06140b73d0 con 0x7f06240d1940 2024-09-10T11:43:54.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.090+0000 7f0622ffd640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06100750a0 0x7f0610077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.090+0000 7f0622ffd640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06100750a0 0x7f0610077560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06240ce2e0 tx=0x7f0618009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.097+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f06140810f0 con 0x7f06240d1940 2024-09-10T11:43:54.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.359+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f06240b2a80 con 0x7f06100750a0 2024-09-10T11:43:54.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.359+0000 7f060bfff640 1 -- 172.21.15.57:0/2300232351 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06240b2a80 con 0x7f06100750a0 2024-09-10T11:43:54.361 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T11:43:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06100750a0 msgr2=0x7f0610077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06100750a0 0x7f0610077560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06240ce2e0 tx=0x7f0618009040 comp rx=0 tx=0).stop 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 msgr2=0x7f06241f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 0x7f06241f5850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0614009850 tx=0x7f06140035f0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 shutdown_connections 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f06100750a0 0x7f0610077560 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.362+0000 7f0629ea2640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f062415dbf0 0x7f06240ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.363+0000 7f0629ea2640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06240d4130 0x7f06241f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.363+0000 7f0629ea2640 1 --2- 172.21.15.57:0/2300232351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06240d1940 0x7f06241f5850 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.363+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 >> 172.21.15.57:0/2300232351 conn(0x7f062408d6d0 msgr2=0x7f06240b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.363+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 shutdown_connections 2024-09-10T11:43:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.363+0000 7f0629ea2640 1 -- 172.21.15.57:0/2300232351 wait complete. 2024-09-10T11:43:54.378 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T11:43:54.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 -- 172.21.15.57:0/1361015943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07980d4290 msgr2=0x7f07980ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 --2- 172.21.15.57:0/1361015943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07980d4290 0x7f07980ce790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0790009be0 tx=0x7f079002a970 comp rx=0 tx=0).stop 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 -- 172.21.15.57:0/1361015943 shutdown_connections 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 --2- 172.21.15.57:0/1361015943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07980d4290 0x7f07980ce790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 -- 172.21.15.57:0/1361015943 >> 172.21.15.57:0/1361015943 conn(0x7f079808d520 msgr2=0x7f079809ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 -- 172.21.15.57:0/1361015943 shutdown_connections 2024-09-10T11:43:54.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.530+0000 7f079dd61640 1 -- 172.21.15.57:0/1361015943 wait complete. 2024-09-10T11:43:54.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.531+0000 7f079dd61640 1 Processor -- start 2024-09-10T11:43:54.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.532+0000 7f079dd61640 1 -- start start 2024-09-10T11:43:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079dd61640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980d4290 0x7f07980b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079dd61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079815dc30 0x7f07980b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079dd61640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0798161790 0x7f07981f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079dd61640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f07980d2450 con 0x7f07980d4290 2024-09-10T11:43:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079dd61640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07980d22d0 con 0x7f079815dc30 2024-09-10T11:43:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079dd61640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f07980d25d0 con 0x7f0798161790 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079cd5f640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980d4290 0x7f07980b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f0797fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079815dc30 0x7f07980b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f0797fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079815dc30 0x7f07980b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58826/0 (socket says 172.21.15.57:58826) 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f0797fff640 1 -- 172.21.15.57:0/741022234 learned_addr learned my addr 172.21.15.57:0/741022234 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.533+0000 7f079d560640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0798161790 0x7f07981f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f0797fff640 1 -- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0798161790 msgr2=0x7f07981f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f0797fff640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0798161790 0x7f07981f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f0797fff640 1 -- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980d4290 msgr2=0x7f07980b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f0797fff640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980d4290 0x7f07980b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f0797fff640 1 -- 172.21.15.57:0/741022234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079815cb80 con 0x7f079815dc30 2024-09-10T11:43:54.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f079cd5f640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07980d4290 0x7f07980b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f0797fff640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079815dc30 0x7f07980b9250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f078400c3c0 tx=0x7f078400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784017070 con 0x7f079815dc30 2024-09-10T11:43:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07840035f0 con 0x7f079815dc30 2024-09-10T11:43:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784003a80 con 0x7f079815dc30 2024-09-10T11:43:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079815ce60 con 0x7f079815dc30 2024-09-10T11:43:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.534+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07980b1fe0 con 0x7f079815dc30 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.535+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f079815b1c0 con 0x7f079815dc30 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.536+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f078401a070 con 0x7f079815dc30 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f07957fa640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f077c0750a0 0x7f077c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f0784095ce0 con 0x7f079815dc30 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f079cd5f640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f077c0750a0 0x7f077c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f07957fa640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f077c07d3c0 0x7f077c07f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 --> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f077c07ff10 con 0x7f077c07d3c0 2024-09-10T11:43:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0784096110 con 0x7f079815dc30 2024-09-10T11:43:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.537+0000 7f079d560640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f077c07d3c0 0x7f077c07f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.538+0000 7f079cd5f640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f077c0750a0 0x7f077c077560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f078c007f20 tx=0x7f078c007eb0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.538+0000 7f079d560640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f077c07d3c0 0x7f077c07f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.539+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== osd.2 v2:172.21.15.57:6816/292362606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f077c07ff10 con 0x7f077c07d3c0 2024-09-10T11:43:54.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.566+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 --> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f07980d2a80 con 0x7f077c07d3c0 2024-09-10T11:43:54.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.566+0000 7f07957fa640 1 -- 172.21.15.57:0/741022234 <== osd.2 v2:172.21.15.57:6816/292362606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f07980d2a80 con 0x7f077c07d3c0 2024-09-10T11:43:54.568 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:54.568 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:54.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.566+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f077c07d3c0 msgr2=0x7f077c07f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.566+0000 7f079dd61640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.57:6816/292362606,v1:172.21.15.57:6817/292362606] conn(0x7f077c07d3c0 0x7f077c07f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.566+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f077c0750a0 msgr2=0x7f077c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.566+0000 7f079dd61640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f077c0750a0 0x7f077c077560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f078c007f20 tx=0x7f078c007eb0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079815dc30 msgr2=0x7f07980b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079dd61640 1 --2- 172.21.15.57:0/741022234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f079815dc30 0x7f07980b9250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f078400c3c0 tx=0x7f078400c880 comp rx=0 tx=0).stop 2024-09-10T11:43:54.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079d560640 1 -- 172.21.15.57:0/741022234 reap_dead start 2024-09-10T11:43:54.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 shutdown_connections 2024-09-10T11:43:54.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 >> 172.21.15.57:0/741022234 conn(0x7f079808d520 msgr2=0x7f0798159970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:54.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 shutdown_connections 2024-09-10T11:43:54.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.567+0000 7f079dd61640 1 -- 172.21.15.57:0/741022234 wait complete. 2024-09-10T11:43:54.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T11:43:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 -- 172.21.15.57:0/1228787740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec815dc60 msgr2=0x7fbec80d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 --2- 172.21.15.57:0/1228787740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec815dc60 0x7fbec80d24a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbec4005fd0 tx=0x7fbec402a670 comp rx=0 tx=0).stop 2024-09-10T11:43:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 -- 172.21.15.57:0/1228787740 shutdown_connections 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 --2- 172.21.15.57:0/1228787740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 0x7fbec80d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 --2- 172.21.15.57:0/1228787740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec815dc60 0x7fbec80d24a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 -- 172.21.15.57:0/1228787740 >> 172.21.15.57:0/1228787740 conn(0x7fbec809cf80 msgr2=0x7fbec80d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 -- 172.21.15.57:0/1228787740 shutdown_connections 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.738+0000 7fbed0286640 1 -- 172.21.15.57:0/1228787740 wait complete. 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.739+0000 7fbed0286640 1 Processor -- start 2024-09-10T11:43:54.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.739+0000 7fbed0286640 1 -- start start 2024-09-10T11:43:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbed0286640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 0x7fbec8156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbed0286640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec815dc60 0x7fbec815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbed0286640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 0x7fbec80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbed0286640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80b8720 con 0x7fbec80d45b0 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbed0286640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80d1ed0 con 0x7fbec815dc60 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbed0286640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbec8162120 con 0x7fbec815e040 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbece022640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 0x7fbec8156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbece022640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 0x7fbec8156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38964/0 (socket says 172.21.15.57:38964) 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.740+0000 7fbece022640 1 -- 172.21.15.57:0/2463167064 learned_addr learned my addr 172.21.15.57:0/2463167064 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece823640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 0x7fbec80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbecd821640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec815dc60 0x7fbec815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece022640 1 -- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 msgr2=0x7fbec80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece022640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 0x7fbec80ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece022640 1 -- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec815dc60 msgr2=0x7fbec815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece022640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec815dc60 0x7fbec815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece022640 1 -- 172.21.15.57:0/2463167064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec81f7aa0 con 0x7fbec80d45b0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece823640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 0x7fbec80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbece022640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 0x7fbec8156410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbec40099f0 tx=0x7fbec40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec403f070 con 0x7fbec80d45b0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec40047a0 con 0x7fbec80d45b0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec81f7d40 con 0x7fbec80d45b0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4035030 con 0x7fbec80d45b0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.741+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec81f8300 con 0x7fbec80d45b0 2024-09-10T11:43:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.743+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec81625d0 con 0x7fbec80d45b0 2024-09-10T11:43:54.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.744+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fbec4042070 con 0x7fbec80d45b0 2024-09-10T11:43:54.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.745+0000 7fbebeffd640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbeac0750a0 0x7fbeac077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:54.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.745+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fbec40b77d0 con 0x7fbec80d45b0 2024-09-10T11:43:54.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.745+0000 7fbecd821640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbeac0750a0 0x7fbeac077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:54.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.746+0000 7fbecd821640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbeac0750a0 0x7fbeac077560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8007fd0 tx=0x7fbeb8009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:54.749+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fbec4081440 con 0x7fbec80d45b0 2024-09-10T11:43:55.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.028+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fbec80b9c60 con 0x7fbeac0750a0 2024-09-10T11:43:55.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.028+0000 7fbebeffd640 1 -- 172.21.15.57:0/2463167064 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbec80b9c60 con 0x7fbeac0750a0 2024-09-10T11:43:55.030 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbeac0750a0 msgr2=0x7fbeac077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbeac0750a0 0x7fbeac077560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8007fd0 tx=0x7fbeb8009040 comp rx=0 tx=0).stop 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 msgr2=0x7fbec8156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 0x7fbec8156410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbec40099f0 tx=0x7fbec40038a0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 shutdown_connections 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fbeac0750a0 0x7fbeac077560 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec815e040 0x7fbec80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec815dc60 0x7fbec815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 --2- 172.21.15.57:0/2463167064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbec80d45b0 0x7fbec8156410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.030+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 >> 172.21.15.57:0/2463167064 conn(0x7fbec809cf80 msgr2=0x7fbec806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.031+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 shutdown_connections 2024-09-10T11:43:55.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.031+0000 7fbed0286640 1 -- 172.21.15.57:0/2463167064 wait complete. 2024-09-10T11:43:55.044 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T11:43:55.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.175+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/802424407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 msgr2=0x7fe4bc0cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.175+0000 7fe4c0ad6640 1 --2- 172.21.15.57:0/802424407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc0cee50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005fd0 tx=0x7fe4b402a8a0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.176+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/802424407 shutdown_connections 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.176+0000 7fe4c0ad6640 1 --2- 172.21.15.57:0/802424407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc0cee50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.176+0000 7fe4c0ad6640 1 --2- 172.21.15.57:0/802424407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4bc15fce0 0x7fe4bc0d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.176+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/802424407 >> 172.21.15.57:0/802424407 conn(0x7fe4bc0d0ae0 msgr2=0x7fe4bc0d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.176+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/802424407 shutdown_connections 2024-09-10T11:43:55.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.176+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/802424407 wait complete. 2024-09-10T11:43:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.177+0000 7fe4c0ad6640 1 Processor -- start 2024-09-10T11:43:55.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.178+0000 7fe4c0ad6640 1 -- start start 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.178+0000 7fe4c0ad6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc1f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.178+0000 7fe4c0ad6640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4bc152a40 0x7fe4bc13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.178+0000 7fe4c0ad6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4bc15fce0 0x7fe4bc1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4c0ad6640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc0cf720 con 0x7fe4bc152a40 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4c0ad6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc0cf5a0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4c0ad6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc0cf8a0 con 0x7fe4bc15fce0 2024-09-10T11:43:55.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc1f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc1f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:58866/0 (socket says 172.21.15.57:58866) 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4b9d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4bc152a40 0x7fe4bc13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 -- 172.21.15.57:0/4049406665 learned_addr learned my addr 172.21.15.57:0/4049406665 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4bad9d640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4bc15fce0 0x7fe4bc1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 -- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4bc15fce0 msgr2=0x7fe4bc1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4bc15fce0 0x7fe4bc1412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 -- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4bc152a40 msgr2=0x7fe4bc13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4bc152a40 0x7fe4bc13e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 -- 172.21.15.57:0/4049406665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc13e5d0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4ba59c640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc1f5f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac001990 tx=0x7fe4ac001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac01d070 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.179+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac010330 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.180+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc1f2870 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.180+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00a8a0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.180+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc140ac0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.180+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4bc140ea0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.182+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fe4ac020070 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.182+0000 7fe4aaffd640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe49c0750a0 0x7fe49c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.182+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fe4ac099fe0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.182+0000 7fe4b9d9b640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe49c0750a0 0x7fe49c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.183+0000 7fe4aaffd640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7fe49c07d3c0 0x7fe49c07f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.183+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 --> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe49c07ff10 con 0x7fe49c07d3c0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.183+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe4ac09a3d0 con 0x7fe4bc06d2e0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.183+0000 7fe4bad9d640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7fe49c07d3c0 0x7fe49c07f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.183+0000 7fe4b9d9b640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe49c0750a0 0x7fe49c077560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00095f0 tx=0x7fe4b0005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.183+0000 7fe4bad9d640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7fe49c07d3c0 0x7fe49c07f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.184+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== osd.3 v2:172.21.15.57:6800/2364480318 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe49c07ff10 con 0x7fe49c07d3c0 2024-09-10T11:43:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.199+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 --> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe4bc0cfdf0 con 0x7fe49c07d3c0 2024-09-10T11:43:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4aaffd640 1 -- 172.21.15.57:0/4049406665 <== osd.3 v2:172.21.15.57:6800/2364480318 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe4bc0cfdf0 con 0x7fe49c07d3c0 2024-09-10T11:43:55.202 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:55.202 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:55.202 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7fe49c07d3c0 msgr2=0x7fe49c07f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.57:6800/2364480318,v1:172.21.15.57:6801/2364480318] conn(0x7fe49c07d3c0 0x7fe49c07f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe49c0750a0 msgr2=0x7fe49c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fe49c0750a0 0x7fe49c077560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00095f0 tx=0x7fe4b0005f90 comp rx=0 tx=0).stop 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 msgr2=0x7fe4bc1f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 --2- 172.21.15.57:0/4049406665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4bc06d2e0 0x7fe4bc1f5f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac001990 tx=0x7fe4ac001e50 comp rx=0 tx=0).stop 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4bad9d640 1 -- 172.21.15.57:0/4049406665 reap_dead start 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 shutdown_connections 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 >> 172.21.15.57:0/4049406665 conn(0x7fe4bc0d0ae0 msgr2=0x7fe4bc070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 shutdown_connections 2024-09-10T11:43:55.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.200+0000 7fe4c0ad6640 1 -- 172.21.15.57:0/4049406665 wait complete. 2024-09-10T11:43:55.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T11:43:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 -- 172.21.15.57:0/2903226727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d04b0 msgr2=0x7f4f940d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2903226727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d04b0 0x7f4f940d1b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4f94051600 tx=0x7f4f8402a560 comp rx=0 tx=0).stop 2024-09-10T11:43:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 -- 172.21.15.57:0/2903226727 shutdown_connections 2024-09-10T11:43:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2903226727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d04b0 0x7f4f940d1b10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2903226727 >> v2:172.21.15.154:3300/0 conn(0x7f4f940d00d0 0x7f4f9415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 -- 172.21.15.57:0/2903226727 >> 172.21.15.57:0/2903226727 conn(0x7f4f9409aa20 msgr2=0x7f4f9409ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 -- 172.21.15.57:0/2903226727 shutdown_connections 2024-09-10T11:43:55.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.337+0000 7f4f9c640640 1 -- 172.21.15.57:0/2903226727 wait complete. 2024-09-10T11:43:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.339+0000 7f4f9c640640 1 Processor -- start 2024-09-10T11:43:55.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.339+0000 7f4f9c640640 1 -- start start 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9c640640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940d00d0 0x7f4f941f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9c640640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f940d04b0 0x7f4f941f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9c640640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 0x7f4f94157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9c640640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940d0ac0 con 0x7f4f940d2050 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9c640640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940cd9a0 con 0x7f4f940d00d0 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9c640640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9415fea0 con 0x7f4f940d04b0 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9a3dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940d00d0 0x7f4f941f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9abdd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 0x7f4f94157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9abdd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 0x7f4f94157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38992/0 (socket says 172.21.15.57:38992) 2024-09-10T11:43:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9abdd640 1 -- 172.21.15.57:0/2418038553 learned_addr learned my addr 172.21.15.57:0/2418038553 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f99bdb640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f940d04b0 0x7f4f941f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9abdd640 1 -- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f940d04b0 msgr2=0x7f4f941f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.340+0000 7f4f9abdd640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f940d04b0 0x7f4f941f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9abdd640 1 -- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940d00d0 msgr2=0x7f4f941f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9abdd640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940d00d0 0x7f4f941f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9abdd640 1 -- 172.21.15.57:0/2418038553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f940c8cf0 con 0x7f4f940d2050 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9a3dc640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940d00d0 0x7f4f941f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9abdd640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 0x7f4f94157e90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c7d0 tx=0x7f4f8c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c003b70 con 0x7f4f940d2050 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f941f67e0 con 0x7f4f940d2050 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f8c003d10 con 0x7f4f940d2050 2024-09-10T11:43:55.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00aab0 con 0x7f4f940d2050 2024-09-10T11:43:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.341+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f940c9240 con 0x7f4f940d2050 2024-09-10T11:43:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.343+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94160350 con 0x7f4f940d2050 2024-09-10T11:43:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.343+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f4f8c00ac50 con 0x7f4f940d2050 2024-09-10T11:43:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.344+0000 7f4f8affd640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4f780750d0 0x7f4f78077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.344+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f4f8c096160 con 0x7f4f940d2050 2024-09-10T11:43:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.344+0000 7f4f9a3dc640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4f780750d0 0x7f4f78077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.345+0000 7f4f9a3dc640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4f780750d0 0x7f4f78077590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009f20 tx=0x7f4f90005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.348+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f4f8c05fd70 con 0x7f4f940d2050 2024-09-10T11:43:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.580+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4f940745e0 con 0x7f4f780750d0 2024-09-10T11:43:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.580+0000 7f4f8affd640 1 -- 172.21.15.57:0/2418038553 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f940745e0 con 0x7f4f780750d0 2024-09-10T11:43:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T11:43:55.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4f780750d0 msgr2=0x7f4f78077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4f780750d0 0x7f4f78077590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009f20 tx=0x7f4f90005f90 comp rx=0 tx=0).stop 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 msgr2=0x7f4f94157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 0x7f4f94157e90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c7d0 tx=0x7f4f8c00cc90 comp rx=0 tx=0).stop 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 shutdown_connections 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f4f780750d0 0x7f4f78077590 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f940d2050 0x7f4f94157e90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f940d04b0 0x7f4f941f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 --2- 172.21.15.57:0/2418038553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f940d00d0 0x7f4f941f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.583+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 >> 172.21.15.57:0/2418038553 conn(0x7f4f9409aa20 msgr2=0x7f4f9415d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.584+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 shutdown_connections 2024-09-10T11:43:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.584+0000 7f4f9c640640 1 -- 172.21.15.57:0/2418038553 wait complete. 2024-09-10T11:43:55.598 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T11:43:55.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:55.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 -- 172.21.15.57:0/2007748012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc070a60 msgr2=0x7f31dc0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 --2- 172.21.15.57:0/2007748012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc070a60 0x7f31dc0b4c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0693f0 tx=0x7f31d402aa30 comp rx=0 tx=0).stop 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 -- 172.21.15.57:0/2007748012 shutdown_connections 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 --2- 172.21.15.57:0/2007748012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc070a60 0x7f31dc0b4c70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 --2- 172.21.15.57:0/2007748012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 0x7f31dc070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 --2- 172.21.15.57:0/2007748012 >> v2:172.21.15.154:3300/0 conn(0x7f31dc15aa10 0x7f31dc15e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 -- 172.21.15.57:0/2007748012 >> 172.21.15.57:0/2007748012 conn(0x7f31dc0d0ae0 msgr2=0x7f31dc0d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 -- 172.21.15.57:0/2007748012 shutdown_connections 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.723+0000 7f31e3840640 1 -- 172.21.15.57:0/2007748012 wait complete. 2024-09-10T11:43:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.725+0000 7f31e3840640 1 Processor -- start 2024-09-10T11:43:55.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.725+0000 7f31e3840640 1 -- start start 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.725+0000 7f31e3840640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31dc070a60 0x7f31dc14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e3840640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 0x7f31dc1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e3840640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc15aa10 0x7f31dc155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e3840640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0d0930 con 0x7f31dc15aa10 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e3840640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0d1810 con 0x7f31dc070a60 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e3840640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0b51b0 con 0x7f31dc0cdc20 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e15dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31dc070a60 0x7f31dc14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 0x7f31dc1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 0x7f31dc1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:54434/0 (socket says 172.21.15.57:54434) 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 -- 172.21.15.57:0/2634707900 learned_addr learned my addr 172.21.15.57:0/2634707900 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e1ddd640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc15aa10 0x7f31dc155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 -- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31dc070a60 msgr2=0x7f31dc14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31dc070a60 0x7f31dc14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 -- 172.21.15.57:0/2634707900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc15aa10 msgr2=0x7f31dc155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31dc15aa10 0x7f31dc155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 -- 172.21.15.57:0/2634707900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc156100 con 0x7f31dc0cdc20 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.726+0000 7f31e0ddb640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 0x7f31dc1555b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9f0 tx=0x7f31cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.727+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00ccc0 con 0x7f31dc0cdc20 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.727+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31cc010430 con 0x7f31dc0cdc20 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.727+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc010860 con 0x7f31dc0cdc20 2024-09-10T11:43:55.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.727+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc1563e0 con 0x7f31dc0cdc20 2024-09-10T11:43:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.727+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc1569a0 con 0x7f31dc0cdc20 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.729+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31dc070520 con 0x7f31dc0cdc20 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.729+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f31cc010a00 con 0x7f31dc0cdc20 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.729+0000 7f31d1ffb640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31c00750a0 0x7f31c0077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.729+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f31cc096e20 con 0x7f31dc0cdc20 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.729+0000 7f31e15dc640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31c00750a0 0x7f31c0077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.730+0000 7f31d1ffb640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7f31c007d440 0x7f31c007f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.730+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 --> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31cc01ee50 con 0x7f31c007d440 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.730+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f31cc099430 con 0x7f31dc0cdc20 2024-09-10T11:43:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.730+0000 7f31e1ddd640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7f31c007d440 0x7f31c007f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.730+0000 7f31e15dc640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31c00750a0 0x7f31c0077560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009b30 tx=0x7f31d8005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.730+0000 7f31e1ddd640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7f31c007d440 0x7f31c007f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.731+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== osd.4 v2:172.21.15.154:6800/3245795650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31cc01ee50 con 0x7f31c007d440 2024-09-10T11:43:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.753+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 --> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f31dc165660 con 0x7f31c007d440 2024-09-10T11:43:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31d1ffb640 1 -- 172.21.15.57:0/2634707900 <== osd.4 v2:172.21.15.154:6800/3245795650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f31dc165660 con 0x7f31c007d440 2024-09-10T11:43:55.756 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:55.756 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:55.756 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7f31c007d440 msgr2=0x7f31c007f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6800/3245795650,v1:172.21.15.154:6801/3245795650] conn(0x7f31c007d440 0x7f31c007f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31c00750a0 msgr2=0x7f31c0077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f31c00750a0 0x7f31c0077560 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009b30 tx=0x7f31d8005f90 comp rx=0 tx=0).stop 2024-09-10T11:43:55.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 msgr2=0x7f31dc1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 --2- 172.21.15.57:0/2634707900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31dc0cdc20 0x7f31dc1555b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9f0 tx=0x7f31cc00eeb0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e1ddd640 1 -- 172.21.15.57:0/2634707900 reap_dead start 2024-09-10T11:43:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 shutdown_connections 2024-09-10T11:43:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.754+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 >> 172.21.15.57:0/2634707900 conn(0x7f31dc0d0ae0 msgr2=0x7f31dc152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.755+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 shutdown_connections 2024-09-10T11:43:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.755+0000 7f31e3840640 1 -- 172.21.15.57:0/2634707900 wait complete. 2024-09-10T11:43:55.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 -- 172.21.15.57:0/270475382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 msgr2=0x7f5760166c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 --2- 172.21.15.57:0/270475382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760166c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5758005fd0 tx=0x7f575802a8b0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 -- 172.21.15.57:0/270475382 shutdown_connections 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 --2- 172.21.15.57:0/270475382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760166c40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 -- 172.21.15.57:0/270475382 >> 172.21.15.57:0/270475382 conn(0x7f576009aa20 msgr2=0x7f576009ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 -- 172.21.15.57:0/270475382 shutdown_connections 2024-09-10T11:43:55.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.918+0000 7f57682b8640 1 -- 172.21.15.57:0/270475382 wait complete. 2024-09-10T11:43:55.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.920+0000 7f57682b8640 1 Processor -- start 2024-09-10T11:43:55.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.920+0000 7f57682b8640 1 -- start start 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f57682b8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600d1a70 0x7f5760153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f57682b8640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 0x7f57600b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f57682b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f57682b8640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f57600b0f30 con 0x7f57600d1e50 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f57682b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f576015bf80 con 0x7f576015b8e0 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f57682b8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5760167180 con 0x7f57600d1a70 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5765853640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 0x7f57600b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5765853640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 0x7f57600b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39016/0 (socket says 172.21.15.57:39016) 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766855640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5765853640 1 -- 172.21.15.57:0/701734313 learned_addr learned my addr 172.21.15.57:0/701734313 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:55.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766054640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600d1a70 0x7f5760153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766855640 1 -- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600d1a70 msgr2=0x7f5760153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766855640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600d1a70 0x7f5760153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766855640 1 -- 172.21.15.57:0/701734313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 msgr2=0x7f57600b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766855640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 0x7f57600b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5766855640 1 -- 172.21.15.57:0/701734313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57600b01d0 con 0x7f576015b8e0 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.921+0000 7f5765853640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 0x7f57600b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.922+0000 7f5766855640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760153320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5760069420 tx=0x7f57580316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.922+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758031990 con 0x7f576015b8e0 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.922+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5758031c20 con 0x7f576015b8e0 2024-09-10T11:43:55.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.922+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758033330 con 0x7f576015b8e0 2024-09-10T11:43:55.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.923+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57601f8280 con 0x7f576015b8e0 2024-09-10T11:43:55.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.923+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5760154450 con 0x7f576015b8e0 2024-09-10T11:43:55.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.924+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5760154730 con 0x7f576015b8e0 2024-09-10T11:43:55.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.925+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f57580334d0 con 0x7f576015b8e0 2024-09-10T11:43:55.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.926+0000 7f5756ffd640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f57440750a0 0x7f5744077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:55.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.926+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f57580b73e0 con 0x7f576015b8e0 2024-09-10T11:43:55.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.926+0000 7f5766054640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f57440750a0 0x7f5744077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:55.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.927+0000 7f5766054640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f57440750a0 0x7f5744077560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f575c007fd0 tx=0x7f575c009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:55.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:55.932+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f575803f030 con 0x7f576015b8e0 2024-09-10T11:43:56.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.209+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5760153d00 con 0x7f57440750a0 2024-09-10T11:43:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.210+0000 7f5756ffd640 1 -- 172.21.15.57:0/701734313 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5760153d00 con 0x7f57440750a0 2024-09-10T11:43:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T11:43:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f57440750a0 msgr2=0x7f5744077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f57440750a0 0x7f5744077560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f575c007fd0 tx=0x7f575c009040 comp rx=0 tx=0).stop 2024-09-10T11:43:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 msgr2=0x7f5760153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760153320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5760069420 tx=0x7f57580316f0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 shutdown_connections 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f57440750a0 0x7f5744077560 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576015b8e0 0x7f5760153320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57600d1e50 0x7f57600b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 --2- 172.21.15.57:0/701734313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600d1a70 0x7f5760153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 >> 172.21.15.57:0/701734313 conn(0x7f576009aa20 msgr2=0x7f57600716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 shutdown_connections 2024-09-10T11:43:56.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.212+0000 7f57682b8640 1 -- 172.21.15.57:0/701734313 wait complete. 2024-09-10T11:43:56.229 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T11:43:56.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.360+0000 7fa308f5d640 1 -- 172.21.15.57:0/3921631487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa30415f580 msgr2=0x7fa30415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.360+0000 7fa308f5d640 1 --2- 172.21.15.57:0/3921631487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa30415f580 0x7fa30415bf90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8005fd0 tx=0x7fa2f802a5f0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.360+0000 7fa308f5d640 1 -- 172.21.15.57:0/3921631487 shutdown_connections 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.360+0000 7fa308f5d640 1 --2- 172.21.15.57:0/3921631487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa30415f580 0x7fa30415bf90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.360+0000 7fa308f5d640 1 -- 172.21.15.57:0/3921631487 >> 172.21.15.57:0/3921631487 conn(0x7fa3040b1530 msgr2=0x7fa3040b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.361+0000 7fa308f5d640 1 -- 172.21.15.57:0/3921631487 shutdown_connections 2024-09-10T11:43:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.361+0000 7fa308f5d640 1 -- 172.21.15.57:0/3921631487 wait complete. 2024-09-10T11:43:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.363+0000 7fa308f5d640 1 Processor -- start 2024-09-10T11:43:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.363+0000 7fa308f5d640 1 -- start start 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa308f5d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30406e840 0x7fa3041466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa308f5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040cc8f0 0x7fa3040c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa308f5d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa30415f580 0x7fa30415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa308f5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa304074100 con 0x7fa3040cc8f0 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa308f5d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa30406ecb0 con 0x7fa30415f580 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa308f5d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa3040c7de0 con 0x7fa30406e840 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040cc8f0 0x7fa3040c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa30259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30406e840 0x7fa3041466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040cc8f0 0x7fa3040c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39036/0 (socket says 172.21.15.57:39036) 2024-09-10T11:43:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 -- 172.21.15.57:0/2143202199 learned_addr learned my addr 172.21.15.57:0/2143202199 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa302d9d640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa30415f580 0x7fa30415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 -- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30406e840 msgr2=0x7fa3041466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30406e840 0x7fa3041466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 -- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa30415f580 msgr2=0x7fa30415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa30415f580 0x7fa30415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.364+0000 7fa301d9b640 1 -- 172.21.15.57:0/2143202199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3040c71d0 con 0x7fa3040cc8f0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.365+0000 7fa301d9b640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040cc8f0 0x7fa3040c6a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8000c00 tx=0x7fa2f8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.365+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f803e030 con 0x7fa3040cc8f0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.365+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2f8003e60 con 0x7fa3040cc8f0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.365+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3040c74b0 con 0x7fa3040cc8f0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.365+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8035040 con 0x7fa3040cc8f0 2024-09-10T11:43:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.365+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3040c7a70 con 0x7fa3040cc8f0 2024-09-10T11:43:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.366+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa30415bf90 con 0x7fa3040cc8f0 2024-09-10T11:43:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.367+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fa2f8041030 con 0x7fa3040cc8f0 2024-09-10T11:43:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa2f2ffd640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e40750a0 0x7fa2e4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa2f80b6a00 con 0x7fa3040cc8f0 2024-09-10T11:43:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa30259c640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e40750a0 0x7fa2e4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa2f2ffd640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fa2e407d3c0 0x7fa2e407f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 --> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2f802eec0 con 0x7fa2e407d3c0 2024-09-10T11:43:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa2f80bb2a0 con 0x7fa3040cc8f0 2024-09-10T11:43:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa302d9d640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fa2e407d3c0 0x7fa2e407f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.368+0000 7fa30259c640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e40750a0 0x7fa2e4077560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4000f60 tx=0x7fa2f4007df0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.369+0000 7fa302d9d640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fa2e407d3c0 0x7fa2e407f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.369+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== osd.5 v2:172.21.15.154:6826/4034291138 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2f802eec0 con 0x7fa2e407d3c0 2024-09-10T11:43:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.391+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 --> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa3040b5280 con 0x7fa2e407d3c0 2024-09-10T11:43:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.391+0000 7fa2f2ffd640 1 -- 172.21.15.57:0/2143202199 <== osd.5 v2:172.21.15.154:6826/4034291138 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa3040b5280 con 0x7fa2e407d3c0 2024-09-10T11:43:56.393 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:56.393 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:56.394 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.391+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fa2e407d3c0 msgr2=0x7fa2e407f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.391+0000 7fa308f5d640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6826/4034291138,v1:172.21.15.154:6827/4034291138] conn(0x7fa2e407d3c0 0x7fa2e407f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e40750a0 msgr2=0x7fa2e4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fa2e40750a0 0x7fa2e4077560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4000f60 tx=0x7fa2f4007df0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040cc8f0 msgr2=0x7fa3040c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 --2- 172.21.15.57:0/2143202199 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040cc8f0 0x7fa3040c6a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8000c00 tx=0x7fa2f8003970 comp rx=0 tx=0).stop 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa302d9d640 1 -- 172.21.15.57:0/2143202199 reap_dead start 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 shutdown_connections 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 >> 172.21.15.57:0/2143202199 conn(0x7fa3040b1530 msgr2=0x7fa30415d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 shutdown_connections 2024-09-10T11:43:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.392+0000 7fa308f5d640 1 -- 172.21.15.57:0/2143202199 wait complete. 2024-09-10T11:43:56.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T11:43:56.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:43:56.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T11:43:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 -- 172.21.15.57:0/4132595175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1415b8e0 msgr2=0x7f2c14166c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 --2- 172.21.15.57:0/4132595175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1415b8e0 0x7f2c14166c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009be0 tx=0x7f2c0c02a890 comp rx=0 tx=0).stop 2024-09-10T11:43:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 -- 172.21.15.57:0/4132595175 shutdown_connections 2024-09-10T11:43:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 --2- 172.21.15.57:0/4132595175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1415b8e0 0x7f2c14166c40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 -- 172.21.15.57:0/4132595175 >> 172.21.15.57:0/4132595175 conn(0x7f2c1409aa20 msgr2=0x7f2c1409ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 -- 172.21.15.57:0/4132595175 shutdown_connections 2024-09-10T11:43:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.529+0000 7f2c1c175640 1 -- 172.21.15.57:0/4132595175 wait complete. 2024-09-10T11:43:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.530+0000 7f2c1c175640 1 Processor -- start 2024-09-10T11:43:56.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 -- start start 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c140d1a70 0x7f2c141539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c140d1e50 0x7f2c14151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 0x7f2c14166870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140b0f90 con 0x7f2c1415b8e0 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1415bf80 con 0x7f2c140d1a70 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.531+0000 7f2c1c175640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c14167180 con 0x7f2c140d1e50 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 0x7f2c14166870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 0x7f2c14166870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39040/0 (socket says 172.21.15.57:39040) 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 -- 172.21.15.57:0/3093877036 learned_addr learned my addr 172.21.15.57:0/3093877036 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:56.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c19f11640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c140d1a70 0x7f2c141539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c19710640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c140d1e50 0x7f2c14151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 -- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c140d1e50 msgr2=0x7f2c14151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c140d1e50 0x7f2c14151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 -- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c140d1a70 msgr2=0x7f2c141539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c140d1a70 0x7f2c141539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 -- 172.21.15.57:0/3093877036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c14154fb0 con 0x7f2c1415b8e0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c19710640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c140d1e50 0x7f2c14151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.532+0000 7f2c1a712640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 0x7f2c14166870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c006010 tx=0x7f2c0c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.533+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c031620 con 0x7f2c1415b8e0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.533+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c0c0319b0 con 0x7f2c1415b8e0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.533+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c14155290 con 0x7f2c1415b8e0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.533+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c031de0 con 0x7f2c1415b8e0 2024-09-10T11:43:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.533+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1414bcd0 con 0x7f2c1415b8e0 2024-09-10T11:43:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.534+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c14155950 con 0x7f2c1415b8e0 2024-09-10T11:43:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.535+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2c0c0330d0 con 0x7f2c1415b8e0 2024-09-10T11:43:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.536+0000 7f2c0a7fc640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2bf80750a0 0x7f2bf8077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.536+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2c0c0b7300 con 0x7f2c1415b8e0 2024-09-10T11:43:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.536+0000 7f2c19f11640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2bf80750a0 0x7f2bf8077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:56.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.537+0000 7f2c19f11640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2bf80750a0 0x7f2bf8077560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c1415aff0 tx=0x7f2c10009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:56.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.543+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2c14155950 con 0x7f2c1415b8e0 2024-09-10T11:43:56.560 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-09-10T11:43:56.559+0000 7fd41ae56640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49048) UID: 0 2024-09-10T11:43:56.561 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-09-10T11:43:56.559+0000 7fd5b0d78640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49048) UID: 0 2024-09-10T11:43:56.561 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-09-10T11:43:56.559+0000 7f739c38f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49048) UID: 0 2024-09-10T11:43:56.561 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-09-10T11:43:56.559+0000 7fd94654a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49048) UID: 0 2024-09-10T11:43:56.774 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T11:43:56.772+0000 7fd4611f6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42191) UID: 0 2024-09-10T11:43:56.774 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T11:43:56.772+0000 7f86b4860640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42191) UID: 0 2024-09-10T11:43:56.774 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T11:43:56.772+0000 7f2f2e502640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42191) UID: 0 2024-09-10T11:43:56.775 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T11:43:56.772+0000 7f1b4f060640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42191) UID: 0 2024-09-10T11:43:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.805+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f2c1415f7e0 con 0x7f2bf80750a0 2024-09-10T11:43:56.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.806+0000 7f2c0a7fc640 1 -- 172.21.15.57:0/3093877036 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c1415f7e0 con 0x7f2bf80750a0 2024-09-10T11:43:56.808 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T11:43:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2bf80750a0 msgr2=0x7f2bf8077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2bf80750a0 0x7f2bf8077560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c1415aff0 tx=0x7f2c10009040 comp rx=0 tx=0).stop 2024-09-10T11:43:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 msgr2=0x7f2c14166870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:56.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 0x7f2c14166870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c006010 tx=0x7f2c0c0039f0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 shutdown_connections 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2bf80750a0 0x7f2bf8077560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c1415b8e0 0x7f2c14166870 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c140d1e50 0x7f2c14151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 --2- 172.21.15.57:0/3093877036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c140d1a70 0x7f2c141539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 >> 172.21.15.57:0/3093877036 conn(0x7f2c1409aa20 msgr2=0x7f2c141568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 shutdown_connections 2024-09-10T11:43:56.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:56.808+0000 7f2c1c175640 1 -- 172.21.15.57:0/3093877036 wait complete. 2024-09-10T11:43:56.825 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T11:43:56.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 -- 172.21.15.57:0/2889612247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d98151aa0 msgr2=0x7f8d980b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 --2- 172.21.15.57:0/2889612247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d98151aa0 0x7f8d980b3a00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8d90005fd0 tx=0x7f8d9002a8b0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 -- 172.21.15.57:0/2889612247 shutdown_connections 2024-09-10T11:43:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 --2- 172.21.15.57:0/2889612247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d98151aa0 0x7f8d980b3a00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 --2- 172.21.15.57:0/2889612247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d980b4a20 0x7f8d9815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 -- 172.21.15.57:0/2889612247 >> 172.21.15.57:0/2889612247 conn(0x7f8d9806d9e0 msgr2=0x7f8d9806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 -- 172.21.15.57:0/2889612247 shutdown_connections 2024-09-10T11:43:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.015+0000 7f8d9fdec640 1 -- 172.21.15.57:0/2889612247 wait complete. 2024-09-10T11:43:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.017+0000 7f8d9fdec640 1 Processor -- start 2024-09-10T11:43:57.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.017+0000 7f8d9fdec640 1 -- start start 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9fdec640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d980b4a20 0x7f8d98153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9fdec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d981516c0 0x7f8d98150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9fdec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98151aa0 0x7f8d981554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9fdec640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9806d1a0 con 0x7f8d980b4a20 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9fdec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9806d020 con 0x7f8d98151aa0 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9fdec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9806d320 con 0x7f8d981516c0 2024-09-10T11:43:57.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9db88640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d980b4a20 0x7f8d98153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9db88640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d980b4a20 0x7f8d98153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39062/0 (socket says 172.21.15.57:39062) 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9db88640 1 -- 172.21.15.57:0/1912823062 learned_addr learned my addr 172.21.15.57:0/1912823062 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9d387640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d981516c0 0x7f8d98150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.018+0000 7f8d9e389640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98151aa0 0x7f8d981554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9e389640 1 -- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d981516c0 msgr2=0x7f8d98150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9e389640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d981516c0 0x7f8d98150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9e389640 1 -- 172.21.15.57:0/1912823062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d980b4a20 msgr2=0x7f8d98153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9e389640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d980b4a20 0x7f8d98153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9e389640 1 -- 172.21.15.57:0/1912823062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d98153080 con 0x7f8d98151aa0 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9db88640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d980b4a20 0x7f8d98153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9e389640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98151aa0 0x7f8d981554c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009000 tx=0x7f8d90003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90031990 con 0x7f8d98151aa0 2024-09-10T11:43:57.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d90031c40 con 0x7f8d98151aa0 2024-09-10T11:43:57.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90033330 con 0x7f8d98151aa0 2024-09-10T11:43:57.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d98153360 con 0x7f8d98151aa0 2024-09-10T11:43:57.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.019+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d98150ac0 con 0x7f8d98151aa0 2024-09-10T11:43:57.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.020+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d9815ef20 con 0x7f8d98151aa0 2024-09-10T11:43:57.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.022+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8d900334d0 con 0x7f8d98151aa0 2024-09-10T11:43:57.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.022+0000 7f8d8e7fc640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8d7c0750a0 0x7f8d7c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.022+0000 7f8d9db88640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8d7c0750a0 0x7f8d7c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.022+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8d900b7820 con 0x7f8d98151aa0 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.023+0000 7f8d8e7fc640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7f8d7c07d3c0 0x7f8d7c07f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.023+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 --> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d90030ec0 con 0x7f8d7c07d3c0 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.023+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8d900b7c50 con 0x7f8d98151aa0 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.023+0000 7f8d9d387640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7f8d7c07d3c0 0x7f8d7c07f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.023+0000 7f8d9db88640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8d7c0750a0 0x7f8d7c077560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d94001c70 tx=0x7f8d94007f50 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.023+0000 7f8d9d387640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7f8d7c07d3c0 0x7f8d7c07f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.025+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== osd.6 v2:172.21.15.154:6818/2363284508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d90030ec0 con 0x7f8d7c07d3c0 2024-09-10T11:43:57.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.045+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 --> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8d980d0b40 con 0x7f8d7c07d3c0 2024-09-10T11:43:57.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d8e7fc640 1 -- 172.21.15.57:0/1912823062 <== osd.6 v2:172.21.15.154:6818/2363284508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8d88009e10 con 0x7f8d7c07d3c0 2024-09-10T11:43:57.048 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:57.048 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:57.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7f8d7c07d3c0 msgr2=0x7f8d7c07f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6818/2363284508,v1:172.21.15.154:6819/2363284508] conn(0x7f8d7c07d3c0 0x7f8d7c07f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8d7c0750a0 msgr2=0x7f8d7c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f8d7c0750a0 0x7f8d7c077560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d94001c70 tx=0x7f8d94007f50 comp rx=0 tx=0).stop 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98151aa0 msgr2=0x7f8d981554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 --2- 172.21.15.57:0/1912823062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98151aa0 0x7f8d981554c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009000 tx=0x7f8d90003970 comp rx=0 tx=0).stop 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9e389640 1 -- 172.21.15.57:0/1912823062 reap_dead start 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 shutdown_connections 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.046+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 >> 172.21.15.57:0/1912823062 conn(0x7f8d9806d9e0 msgr2=0x7f8d980b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.047+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 shutdown_connections 2024-09-10T11:43:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.047+0000 7f8d9fdec640 1 -- 172.21.15.57:0/1912823062 wait complete. 2024-09-10T11:43:57.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T11:43:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 -- 172.21.15.57:0/1440481028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8415ade0 msgr2=0x7f2b84073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 --2- 172.21.15.57:0/1440481028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8415ade0 0x7f2b84073e10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b840ce230 tx=0x7f2b7802a510 comp rx=0 tx=0).stop 2024-09-10T11:43:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 -- 172.21.15.57:0/1440481028 shutdown_connections 2024-09-10T11:43:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 --2- 172.21.15.57:0/1440481028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b8415ade0 0x7f2b84073e10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 -- 172.21.15.57:0/1440481028 >> 172.21.15.57:0/1440481028 conn(0x7f2b840b1da0 msgr2=0x7f2b840b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 -- 172.21.15.57:0/1440481028 shutdown_connections 2024-09-10T11:43:57.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.207+0000 7f2b89623640 1 -- 172.21.15.57:0/1440481028 wait complete. 2024-09-10T11:43:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.210+0000 7f2b89623640 1 Processor -- start 2024-09-10T11:43:57.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.210+0000 7f2b89623640 1 -- start start 2024-09-10T11:43:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b89623640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 0x7f2b840aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b89623640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b8415aa00 0x7f2b840b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b89623640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b8415ade0 0x7f2b840c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b82ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 0x7f2b840aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b89623640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2b840b3f20 con 0x7f2b84074350 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b89623640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b840b3da0 con 0x7f2b8415ade0 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b89623640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2b840b40a0 con 0x7f2b8415aa00 2024-09-10T11:43:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b82ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 0x7f2b840aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39078/0 (socket says 172.21.15.57:39078) 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1646179441 learned_addr learned my addr 172.21.15.57:0/1646179441 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b827fc640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b8415aa00 0x7f2b840b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.211+0000 7f2b837fe640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b8415ade0 0x7f2b840c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b8415aa00 msgr2=0x7f2b840b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b8415aa00 0x7f2b840b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b8415ade0 msgr2=0x7f2b840c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b8415ade0 0x7f2b840c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b82ffd640 1 -- 172.21.15.57:0/1646179441 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b840c8470 con 0x7f2b84074350 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b82ffd640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 0x7f2b840aed30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2b74001e10 tx=0x7f2b7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7401e070 con 0x7f2b84074350 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b7400ab60 con 0x7f2b84074350 2024-09-10T11:43:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011560 con 0x7f2b84074350 2024-09-10T11:43:57.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b840c8190 con 0x7f2b84074350 2024-09-10T11:43:57.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.212+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b840ae530 con 0x7f2b84074350 2024-09-10T11:43:57.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.214+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b840b4530 con 0x7f2b84074350 2024-09-10T11:43:57.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.214+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f2b74021070 con 0x7f2b84074350 2024-09-10T11:43:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.215+0000 7f2b6b7fe640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2b700750a0 0x7f2b70077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.215+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f2b74099cd0 con 0x7f2b84074350 2024-09-10T11:43:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.215+0000 7f2b827fc640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2b700750a0 0x7f2b70077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.216+0000 7f2b827fc640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2b700750a0 0x7f2b70077560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b78034000 tx=0x7f2b78004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.219+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f2b84074760 con 0x7f2b84074350 2024-09-10T11:43:57.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.431+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f2b8406f7e0 con 0x7f2b700750a0 2024-09-10T11:43:57.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.432+0000 7f2b6b7fe640 1 -- 172.21.15.57:0/1646179441 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2b8406f7e0 con 0x7f2b700750a0 2024-09-10T11:43:57.434 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T11:43:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2b700750a0 msgr2=0x7f2b70077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2b700750a0 0x7f2b70077560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b78034000 tx=0x7f2b78004730 comp rx=0 tx=0).stop 2024-09-10T11:43:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 msgr2=0x7f2b840aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 0x7f2b840aed30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2b74001e10 tx=0x7f2b7400cbf0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 shutdown_connections 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f2b700750a0 0x7f2b70077560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b8415ade0 0x7f2b840c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b8415aa00 0x7f2b840b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 --2- 172.21.15.57:0/1646179441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b84074350 0x7f2b840aed30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 >> 172.21.15.57:0/1646179441 conn(0x7f2b840b1da0 msgr2=0x7f2b840b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 shutdown_connections 2024-09-10T11:43:57.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.435+0000 7f2b89623640 1 -- 172.21.15.57:0/1646179441 wait complete. 2024-09-10T11:43:57.452 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T11:43:57.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T11:43:57.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 -- 172.21.15.57:0/919809740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55880b6b90 msgr2=0x7f55880d2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 --2- 172.21.15.57:0/919809740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55880b6b90 0x7f55880d2210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f557c009830 tx=0x7f557c02a3f0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 -- 172.21.15.57:0/919809740 shutdown_connections 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 --2- 172.21.15.57:0/919809740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55880b6b90 0x7f55880d2210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 --2- 172.21.15.57:0/919809740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f558815de50 0x7f55880d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 -- 172.21.15.57:0/919809740 >> 172.21.15.57:0/919809740 conn(0x7f55880d3d60 msgr2=0x7f55880d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 -- 172.21.15.57:0/919809740 shutdown_connections 2024-09-10T11:43:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.606+0000 7f558cc3c640 1 -- 172.21.15.57:0/919809740 wait complete. 2024-09-10T11:43:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.608+0000 7f558cc3c640 1 Processor -- start 2024-09-10T11:43:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.608+0000 7f558cc3c640 1 -- start start 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f558cc3c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55880b6b90 0x7f55881f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f558cc3c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55880d4880 0x7f55881f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f558cc3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558815de50 0x7f55880b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f558cc3c640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f55880d2ae0 con 0x7f55880d4880 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f558cc3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55880d2960 con 0x7f558815de50 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f558cc3c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f55880b2970 con 0x7f55880b6b90 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f5585d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55880d4880 0x7f55881f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f5585d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55880d4880 0x7f55881f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39094/0 (socket says 172.21.15.57:39094) 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f5585d9b640 1 -- 172.21.15.57:0/3043409134 learned_addr learned my addr 172.21.15.57:0/3043409134 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.609+0000 7f5586d9d640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558815de50 0x7f55880b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f558659c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55880b6b90 0x7f55881f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5585d9b640 1 -- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55880b6b90 msgr2=0x7f55881f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5585d9b640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55880b6b90 0x7f55881f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5585d9b640 1 -- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558815de50 msgr2=0x7f55880b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5585d9b640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558815de50 0x7f55880b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5585d9b640 1 -- 172.21.15.57:0/3043409134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55881f4980 con 0x7f55880d4880 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f558659c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55880b6b90 0x7f55881f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5585d9b640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55880d4880 0x7f55881f4440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f557c009950 tx=0x7f557c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c040070 con 0x7f55880d4880 2024-09-10T11:43:57.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f557c005310 con 0x7f55880d4880 2024-09-10T11:43:57.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c005c90 con 0x7f55880d4880 2024-09-10T11:43:57.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55881f4ee0 con 0x7f55880d4880 2024-09-10T11:43:57.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.610+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558809fa80 con 0x7f55880d4880 2024-09-10T11:43:57.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.611+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55880b2e40 con 0x7f55880d4880 2024-09-10T11:43:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f557c039040 con 0x7f55880d4880 2024-09-10T11:43:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f5576ffd640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55680750d0 0x7f5568077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f557c0b7730 con 0x7f55880d4880 2024-09-10T11:43:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f558659c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55680750d0 0x7f5568077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f5576ffd640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7f556807d3f0 0x7f556807f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 --> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f556807ff40 con 0x7f556807d3f0 2024-09-10T11:43:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.613+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f557c0b7b60 con 0x7f55880d4880 2024-09-10T11:43:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.614+0000 7f5586d9d640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7f556807d3f0 0x7f556807f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.614+0000 7f558659c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55680750d0 0x7f5568077590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5578009ab0 tx=0x7f5578005f90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.614+0000 7f5586d9d640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7f556807d3f0 0x7f556807f870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.615+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== osd.7 v2:172.21.15.154:6808/2303779163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f556807ff40 con 0x7f556807d3f0 2024-09-10T11:43:57.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.631+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 --> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5588161130 con 0x7f556807d3f0 2024-09-10T11:43:57.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f5576ffd640 1 -- 172.21.15.57:0/3043409134 <== osd.7 v2:172.21.15.154:6808/2303779163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5588161130 con 0x7f556807d3f0 2024-09-10T11:43:57.634 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-09-10T11:43:57.634 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T11:43:57.634 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7f556807d3f0 msgr2=0x7f556807f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6808/2303779163,v1:172.21.15.154:6809/2303779163] conn(0x7f556807d3f0 0x7f556807f870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55680750d0 msgr2=0x7f5568077590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f55680750d0 0x7f5568077590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5578009ab0 tx=0x7f5578005f90 comp rx=0 tx=0).stop 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55880d4880 msgr2=0x7f55881f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 --2- 172.21.15.57:0/3043409134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55880d4880 0x7f55881f4440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f557c009950 tx=0x7f557c032c10 comp rx=0 tx=0).stop 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f5586d9d640 1 -- 172.21.15.57:0/3043409134 reap_dead start 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 shutdown_connections 2024-09-10T11:43:57.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.632+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 >> 172.21.15.57:0/3043409134 conn(0x7f55880d3d60 msgr2=0x7f55880d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.633+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 shutdown_connections 2024-09-10T11:43:57.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.633+0000 7f558cc3c640 1 -- 172.21.15.57:0/3043409134 wait complete. 2024-09-10T11:43:57.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T11:43:57.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 -- 172.21.15.57:0/169009691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100d0440 msgr2=0x7f811006fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 --2- 172.21.15.57:0/169009691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100d0440 0x7f811006fd90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f810c005fd0 tx=0x7f810c02a5d0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 -- 172.21.15.57:0/169009691 shutdown_connections 2024-09-10T11:43:57.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 --2- 172.21.15.57:0/169009691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100d0440 0x7f811006fd90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 --2- 172.21.15.57:0/169009691 >> v2:172.21.15.154:3300/0 conn(0x7f811015aaa0 0x7f81100740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 -- 172.21.15.57:0/169009691 >> 172.21.15.57:0/169009691 conn(0x7f81100d0a60 msgr2=0x7f81100d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:57.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 -- 172.21.15.57:0/169009691 shutdown_connections 2024-09-10T11:43:57.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.794+0000 7f8118583640 1 -- 172.21.15.57:0/169009691 wait complete. 2024-09-10T11:43:57.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.796+0000 7f8118583640 1 Processor -- start 2024-09-10T11:43:57.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.796+0000 7f8118583640 1 -- start start 2024-09-10T11:43:57.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8118583640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100cc1d0 0x7f811014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8118583640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81100d0440 0x7f81100b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8118583640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 0x7f8110152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8118583640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f81100cc800 con 0x7f811015aaa0 2024-09-10T11:43:57.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8116b20640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 0x7f8110152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8115b1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81100d0440 0x7f81100b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8116b20640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 0x7f8110152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39106/0 (socket says 172.21.15.57:39106) 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8116b20640 1 -- 172.21.15.57:0/524225234 learned_addr learned my addr 172.21.15.57:0/524225234 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8115b1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81100d0440 0x7f81100b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.57:59000/0 (socket says 172.21.15.57:59000) 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f811631f640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100cc1d0 0x7f811014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81100cc680 con 0x7f81100d0440 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.798+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f81100cc980 con 0x7f81100cc1d0 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f811631f640 1 -- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81100d0440 msgr2=0x7f81100b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f811631f640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81100d0440 0x7f81100b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f811631f640 1 -- 172.21.15.57:0/524225234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 msgr2=0x7f8110152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f811631f640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 0x7f8110152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f811631f640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81100b3b00 con 0x7f81100cc1d0 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f8116b20640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 0x7f8110152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T11:43:57.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f811631f640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100cc1d0 0x7f811014de40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f810000e6d0 tx=0x7f810000eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810000cab0 con 0x7f81100cc1d0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f810000cd40 con 0x7f81100cc1d0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100010690 con 0x7f81100cc1d0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81100b3de0 con 0x7f81100cc1d0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.799+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81100b43a0 con 0x7f81100cc1d0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.801+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811015f150 con 0x7f81100cc1d0 2024-09-10T11:43:57.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.801+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f8100010830 con 0x7f81100cc1d0 2024-09-10T11:43:57.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.802+0000 7f8106ffd640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f80f40750a0 0x7f80f4077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:57.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.802+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8100096c80 con 0x7f81100cc1d0 2024-09-10T11:43:57.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.802+0000 7f8115b1e640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f80f40750a0 0x7f80f4077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:57.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.803+0000 7f8115b1e640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f80f40750a0 0x7f80f4077560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f810c033000 tx=0x7f810c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:57.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:57.806+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8100060910 con 0x7f81100cc1d0 2024-09-10T11:43:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.037+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f81100b69e0 con 0x7f80f40750a0 2024-09-10T11:43:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.037+0000 7f8106ffd640 1 -- 172.21.15.57:0/524225234 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f81100b69e0 con 0x7f80f40750a0 2024-09-10T11:43:58.039 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T11:43:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f80f40750a0 msgr2=0x7f80f4077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f80f40750a0 0x7f80f4077560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f810c033000 tx=0x7f810c004730 comp rx=0 tx=0).stop 2024-09-10T11:43:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100cc1d0 msgr2=0x7f811014de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100cc1d0 0x7f811014de40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f810000e6d0 tx=0x7f810000eb90 comp rx=0 tx=0).stop 2024-09-10T11:43:58.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 shutdown_connections 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f80f40750a0 0x7f80f4077560 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f811015aaa0 0x7f8110152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81100d0440 0x7f81100b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 --2- 172.21.15.57:0/524225234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81100cc1d0 0x7f811014de40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 >> 172.21.15.57:0/524225234 conn(0x7f81100d0a60 msgr2=0x7f81100d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 shutdown_connections 2024-09-10T11:43:58.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.040+0000 7f8118583640 1 -- 172.21.15.57:0/524225234 wait complete. 2024-09-10T11:43:58.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:43:58.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 -- 172.21.15.57:0/156697094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015dc60 msgr2=0x7f87400d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 --2- 172.21.15.57:0/156697094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015dc60 0x7f87400d24a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f87400695f0 tx=0x7f873c02a6c0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 -- 172.21.15.57:0/156697094 shutdown_connections 2024-09-10T11:43:58.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 --2- 172.21.15.57:0/156697094 >> v2:172.21.15.57:3300/0 conn(0x7f87400d45b0 0x7f87400d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 --2- 172.21.15.57:0/156697094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015dc60 0x7f87400d24a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 -- 172.21.15.57:0/156697094 >> 172.21.15.57:0/156697094 conn(0x7f874009cf80 msgr2=0x7f87400d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:58.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 -- 172.21.15.57:0/156697094 shutdown_connections 2024-09-10T11:43:58.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.174+0000 7f87485ab640 1 -- 172.21.15.57:0/156697094 wait complete. 2024-09-10T11:43:58.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.176+0000 7f87485ab640 1 Processor -- start 2024-09-10T11:43:58.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.176+0000 7f87485ab640 1 -- start start 2024-09-10T11:43:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f87485ab640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87400d45b0 0x7f874015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f87485ab640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 0x7f8740156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f87485ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015e040 0x7f874015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f87485ab640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f87400d1e40 con 0x7f874015dc60 2024-09-10T11:43:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f87485ab640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87400d1cc0 con 0x7f874015e040 2024-09-10T11:43:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f87485ab640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f87400d1fc0 con 0x7f87400d45b0 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 0x7f8740156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 0x7f8740156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39124/0 (socket says 172.21.15.57:39124) 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 -- 172.21.15.57:0/807510159 learned_addr learned my addr 172.21.15.57:0/807510159 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8746b48640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015e040 0x7f874015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8746347640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87400d45b0 0x7f874015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 -- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87400d45b0 msgr2=0x7f874015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87400d45b0 0x7f874015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 -- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015e040 msgr2=0x7f874015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015e040 0x7f874015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.177+0000 7f8745b46640 1 -- 172.21.15.57:0/807510159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874015fc60 con 0x7f874015dc60 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.178+0000 7f8745b46640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 0x7f8740156150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f873000ea20 tx=0x7f873000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.178+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873000cd80 con 0x7f874015dc60 2024-09-10T11:43:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.178+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8730010430 con 0x7f874015dc60 2024-09-10T11:43:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.178+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730010840 con 0x7f874015dc60 2024-09-10T11:43:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.178+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87400c8b80 con 0x7f874015dc60 2024-09-10T11:43:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.178+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87400c9140 con 0x7f874015dc60 2024-09-10T11:43:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.179+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87400c8970 con 0x7f874015dc60 2024-09-10T11:43:58.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.181+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f87300109e0 con 0x7f874015dc60 2024-09-10T11:43:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.181+0000 7f8736ffd640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87240750a0 0x7f8724077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:43:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.181+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8730096e10 con 0x7f874015dc60 2024-09-10T11:43:58.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.181+0000 7f8746347640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87240750a0 0x7f8724077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:43:58.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.182+0000 7f8746347640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87240750a0 0x7f8724077560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f873c033000 tx=0x7f873c004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:43:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.186+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f8730060b30 con 0x7f874015dc60 2024-09-10T11:43:58.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.392+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8740162490 con 0x7f87240750a0 2024-09-10T11:43:58.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.400+0000 7f8736ffd640 1 -- 172.21.15.57:0/807510159 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f8740162490 con 0x7f87240750a0 2024-09-10T11:43:58.404 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:43:58.406 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:43:58.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87240750a0 msgr2=0x7f8724077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87240750a0 0x7f8724077560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f873c033000 tx=0x7f873c004730 comp rx=0 tx=0).stop 2024-09-10T11:43:58.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 msgr2=0x7f8740156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 0x7f8740156150 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f873000ea20 tx=0x7f873000eee0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 shutdown_connections 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f87240750a0 0x7f8724077560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874015e040 0x7f874015f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f874015dc60 0x7f8740156150 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 --2- 172.21.15.57:0/807510159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87400d45b0 0x7f874015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 >> 172.21.15.57:0/807510159 conn(0x7f874009cf80 msgr2=0x7f874006e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 shutdown_connections 2024-09-10T11:43:58.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:43:58.404+0000 7f87485ab640 1 -- 172.21.15.57:0/807510159 wait complete. 2024-09-10T11:43:58.419 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-10T11:43:58.252144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235984,"kb_used_data":3112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738736,"statfs":{"total":773094113280,"available":772852465664,"internally_reserved":0,"allocated":3186688,"data_stored":1887852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002420"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.621023+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:40:44.621023+0000","last_peered":"2024-09-10T11:40:44.621023+0000","last_clean":"2024-09-10T11:40:44.621023+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:40:44.621023+0000","last_undegraded":"2024-09-10T11:40:44.621023+0000","last_fullsized":"2024-09-10T11:40:44.621023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625716+0000","last_change":"2024-09-10T11:38:36.639214+0000","last_active":"2024-09-10T11:40:44.625716+0000","last_peered":"2024-09-10T11:40:44.625716+0000","last_clean":"2024-09-10T11:40:44.625716+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:40:44.625716+0000","last_undegraded":"2024-09-10T11:40:44.625716+0000","last_fullsized":"2024-09-10T11:40:44.625716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626827+0000","last_change":"2024-09-10T11:38:36.640427+0000","last_active":"2024-09-10T11:40:44.626827+0000","last_peered":"2024-09-10T11:40:44.626827+0000","last_clean":"2024-09-10T11:40:44.626827+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:40:44.626827+0000","last_undegraded":"2024-09-10T11:40:44.626827+0000","last_fullsized":"2024-09-10T11:40:44.626827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622727+0000","last_change":"2024-09-10T11:38:36.651745+0000","last_active":"2024-09-10T11:40:39.622727+0000","last_peered":"2024-09-10T11:40:39.622727+0000","last_clean":"2024-09-10T11:40:39.622727+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:40:39.622727+0000","last_undegraded":"2024-09-10T11:40:39.622727+0000","last_fullsized":"2024-09-10T11:40:39.622727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:26.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623143+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:41:09.623143+0000","last_peered":"2024-09-10T11:41:09.623143+0000","last_clean":"2024-09-10T11:41:09.623143+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:41:09.623143+0000","last_undegraded":"2024-09-10T11:41:09.623143+0000","last_fullsized":"2024-09-10T11:41:09.623143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625526+0000","last_change":"2024-09-10T11:38:36.642109+0000","last_active":"2024-09-10T11:41:09.625526+0000","last_peered":"2024-09-10T11:41:09.625526+0000","last_clean":"2024-09-10T11:41:09.625526+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:41:09.625526+0000","last_undegraded":"2024-09-10T11:41:09.625526+0000","last_fullsized":"2024-09-10T11:41:09.625526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:51.751727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623125+0000","last_change":"2024-09-10T11:38:36.649637+0000","last_active":"2024-09-10T11:41:09.623125+0000","last_peered":"2024-09-10T11:41:09.623125+0000","last_clean":"2024-09-10T11:41:09.623125+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:41:09.623125+0000","last_undegraded":"2024-09-10T11:41:09.623125+0000","last_fullsized":"2024-09-10T11:41:09.623125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625143+0000","last_change":"2024-09-10T11:38:36.639347+0000","last_active":"2024-09-10T11:41:09.625143+0000","last_peered":"2024-09-10T11:41:09.625143+0000","last_clean":"2024-09-10T11:41:09.625143+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:41:09.625143+0000","last_undegraded":"2024-09-10T11:41:09.625143+0000","last_fullsized":"2024-09-10T11:41:09.625143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622777+0000","last_change":"2024-09-10T11:38:36.652968+0000","last_active":"2024-09-10T11:41:04.622777+0000","last_peered":"2024-09-10T11:41:04.622777+0000","last_clean":"2024-09-10T11:41:04.622777+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:41:04.622777+0000","last_undegraded":"2024-09-10T11:41:04.622777+0000","last_fullsized":"2024-09-10T11:41:04.622777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630356+0000","last_change":"2024-09-10T11:38:36.644873+0000","last_active":"2024-09-10T11:41:04.630356+0000","last_peered":"2024-09-10T11:41:04.630356+0000","last_clean":"2024-09-10T11:41:04.630356+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:41:04.630356+0000","last_undegraded":"2024-09-10T11:41:04.630356+0000","last_fullsized":"2024-09-10T11:41:04.630356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630342+0000","last_change":"2024-09-10T11:38:36.644199+0000","last_active":"2024-09-10T11:41:04.630342+0000","last_peered":"2024-09-10T11:41:04.630342+0000","last_clean":"2024-09-10T11:41:04.630342+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:41:04.630342+0000","last_undegraded":"2024-09-10T11:41:04.630342+0000","last_fullsized":"2024-09-10T11:41:04.630342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.621969+0000","last_change":"2024-09-10T11:38:36.643927+0000","last_active":"2024-09-10T11:41:04.621969+0000","last_peered":"2024-09-10T11:41:04.621969+0000","last_clean":"2024-09-10T11:41:04.621969+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:41:04.621969+0000","last_undegraded":"2024-09-10T11:41:04.621969+0000","last_fullsized":"2024-09-10T11:41:04.621969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:39:19.616974+0000","last_change":"2024-09-10T11:39:17.817004+0000","last_active":"2024-09-10T11:39:19.616974+0000","last_peered":"2024-09-10T11:39:19.616974+0000","last_clean":"2024-09-10T11:39:19.616974+0000","last_became_active":"2024-09-10T11:39:17.816727+0000","last_became_peered":"2024-09-10T11:39:17.816727+0000","last_unstale":"2024-09-10T11:39:19.616974+0000","last_undegraded":"2024-09-10T11:39:19.616974+0000","last_fullsized":"2024-09-10T11:39:19.616974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:06.930996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628297+0000","last_change":"2024-09-10T11:38:36.643189+0000","last_active":"2024-09-10T11:40:59.628297+0000","last_peered":"2024-09-10T11:40:59.628297+0000","last_clean":"2024-09-10T11:40:59.628297+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:40:59.628297+0000","last_undegraded":"2024-09-10T11:40:59.628297+0000","last_fullsized":"2024-09-10T11:40:59.628297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:39.289860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.626910+0000","last_change":"2024-09-10T11:38:36.630056+0000","last_active":"2024-09-10T11:40:59.626910+0000","last_peered":"2024-09-10T11:40:59.626910+0000","last_clean":"2024-09-10T11:40:59.626910+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:40:59.626910+0000","last_undegraded":"2024-09-10T11:40:59.626910+0000","last_fullsized":"2024-09-10T11:40:59.626910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624584+0000","last_change":"2024-09-10T11:38:36.642880+0000","last_active":"2024-09-10T11:40:59.624584+0000","last_peered":"2024-09-10T11:40:59.624584+0000","last_clean":"2024-09-10T11:40:59.624584+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:40:59.624584+0000","last_undegraded":"2024-09-10T11:40:59.624584+0000","last_fullsized":"2024-09-10T11:40:59.624584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624632+0000","last_change":"2024-09-10T11:38:36.644440+0000","last_active":"2024-09-10T11:40:59.624632+0000","last_peered":"2024-09-10T11:40:59.624632+0000","last_clean":"2024-09-10T11:40:59.624632+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:40:59.624632+0000","last_undegraded":"2024-09-10T11:40:59.624632+0000","last_fullsized":"2024-09-10T11:40:59.624632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:23.717934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625550+0000","last_change":"2024-09-10T11:38:36.647662+0000","last_active":"2024-09-10T11:40:59.625550+0000","last_peered":"2024-09-10T11:40:59.625550+0000","last_clean":"2024-09-10T11:40:59.625550+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:40:59.625550+0000","last_undegraded":"2024-09-10T11:40:59.625550+0000","last_fullsized":"2024-09-10T11:40:59.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:40.259631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621920+0000","last_change":"2024-09-10T11:38:36.653670+0000","last_active":"2024-09-10T11:40:54.621920+0000","last_peered":"2024-09-10T11:40:54.621920+0000","last_clean":"2024-09-10T11:40:54.621920+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:40:54.621920+0000","last_undegraded":"2024-09-10T11:40:54.621920+0000","last_fullsized":"2024-09-10T11:40:54.621920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.989794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629284+0000","last_change":"2024-09-10T11:38:36.644425+0000","last_active":"2024-09-10T11:40:54.629284+0000","last_peered":"2024-09-10T11:40:54.629284+0000","last_clean":"2024-09-10T11:40:54.629284+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:40:54.629284+0000","last_undegraded":"2024-09-10T11:40:54.629284+0000","last_fullsized":"2024-09-10T11:40:54.629284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629142+0000","last_change":"2024-09-10T11:39:17.816383+0000","last_active":"2024-09-10T11:41:34.629142+0000","last_peered":"2024-09-10T11:41:34.629142+0000","last_clean":"2024-09-10T11:41:34.629142+0000","last_became_active":"2024-09-10T11:39:17.816084+0000","last_became_peered":"2024-09-10T11:39:17.816084+0000","last_unstale":"2024-09-10T11:41:34.629142+0000","last_undegraded":"2024-09-10T11:41:34.629142+0000","last_fullsized":"2024-09-10T11:41:34.629142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:34.629050+0000","last_change":"2024-09-10T11:39:17.814534+0000","last_active":"2024-09-10T11:41:34.629050+0000","last_peered":"2024-09-10T11:41:34.629050+0000","last_clean":"2024-09-10T11:41:34.629050+0000","last_became_active":"2024-09-10T11:39:17.814205+0000","last_became_peered":"2024-09-10T11:39:17.814205+0000","last_unstale":"2024-09-10T11:41:34.629050+0000","last_undegraded":"2024-09-10T11:41:34.629050+0000","last_fullsized":"2024-09-10T11:41:34.629050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:04.514133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623787+0000","last_change":"2024-09-10T11:38:36.638412+0000","last_active":"2024-09-10T11:40:54.623787+0000","last_peered":"2024-09-10T11:40:54.623787+0000","last_clean":"2024-09-10T11:40:54.623787+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:40:54.623787+0000","last_undegraded":"2024-09-10T11:40:54.623787+0000","last_fullsized":"2024-09-10T11:40:54.623787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623688+0000","last_change":"2024-09-10T11:38:36.648673+0000","last_active":"2024-09-10T11:40:49.623688+0000","last_peered":"2024-09-10T11:40:49.623688+0000","last_clean":"2024-09-10T11:40:49.623688+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:40:49.623688+0000","last_undegraded":"2024-09-10T11:40:49.623688+0000","last_fullsized":"2024-09-10T11:40:49.623688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623386+0000","last_change":"2024-09-10T11:38:36.639466+0000","last_active":"2024-09-10T11:40:49.623386+0000","last_peered":"2024-09-10T11:40:49.623386+0000","last_clean":"2024-09-10T11:40:49.623386+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:40:49.623386+0000","last_undegraded":"2024-09-10T11:40:49.623386+0000","last_fullsized":"2024-09-10T11:40:49.623386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.231704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628912+0000","last_change":"2024-09-10T11:38:36.643065+0000","last_active":"2024-09-10T11:40:49.628912+0000","last_peered":"2024-09-10T11:40:49.628912+0000","last_clean":"2024-09-10T11:40:49.628912+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:40:49.628912+0000","last_undegraded":"2024-09-10T11:40:49.628912+0000","last_fullsized":"2024-09-10T11:40:49.628912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626088+0000","last_change":"2024-09-10T11:38:36.636471+0000","last_active":"2024-09-10T11:40:49.626088+0000","last_peered":"2024-09-10T11:40:49.626088+0000","last_clean":"2024-09-10T11:40:49.626088+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:40:49.626088+0000","last_undegraded":"2024-09-10T11:40:49.626088+0000","last_fullsized":"2024-09-10T11:40:49.626088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:31.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623363+0000","last_change":"2024-09-10T11:38:36.640908+0000","last_active":"2024-09-10T11:40:49.623363+0000","last_peered":"2024-09-10T11:40:49.623363+0000","last_clean":"2024-09-10T11:40:49.623363+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:40:49.623363+0000","last_undegraded":"2024-09-10T11:40:49.623363+0000","last_fullsized":"2024-09-10T11:40:49.623363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626811+0000","last_change":"2024-09-10T11:38:36.651616+0000","last_active":"2024-09-10T11:40:44.626811+0000","last_peered":"2024-09-10T11:40:44.626811+0000","last_clean":"2024-09-10T11:40:44.626811+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:40:44.626811+0000","last_undegraded":"2024-09-10T11:40:44.626811+0000","last_fullsized":"2024-09-10T11:40:44.626811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:47.551516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623181+0000","last_change":"2024-09-10T11:38:36.654579+0000","last_active":"2024-09-10T11:40:44.623181+0000","last_peered":"2024-09-10T11:40:44.623181+0000","last_clean":"2024-09-10T11:40:44.623181+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:40:44.623181+0000","last_undegraded":"2024-09-10T11:40:44.623181+0000","last_fullsized":"2024-09-10T11:40:44.623181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:45.278404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624234+0000","last_change":"2024-09-10T11:38:36.636570+0000","last_active":"2024-09-10T11:40:44.624234+0000","last_peered":"2024-09-10T11:40:44.624234+0000","last_clean":"2024-09-10T11:40:44.624234+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:40:44.624234+0000","last_undegraded":"2024-09-10T11:40:44.624234+0000","last_fullsized":"2024-09-10T11:40:44.624234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628530+0000","last_change":"2024-09-10T11:38:36.649715+0000","last_active":"2024-09-10T11:40:44.628530+0000","last_peered":"2024-09-10T11:40:44.628530+0000","last_clean":"2024-09-10T11:40:44.628530+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:40:44.628530+0000","last_undegraded":"2024-09-10T11:40:44.628530+0000","last_fullsized":"2024-09-10T11:40:44.628530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.622330+0000","last_change":"2024-09-10T11:38:36.631316+0000","last_active":"2024-09-10T11:41:09.622330+0000","last_peered":"2024-09-10T11:41:09.622330+0000","last_clean":"2024-09-10T11:41:09.622330+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:41:09.622330+0000","last_undegraded":"2024-09-10T11:41:09.622330+0000","last_fullsized":"2024-09-10T11:41:09.622330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:00.244528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625179+0000","last_change":"2024-09-10T11:38:35.641436+0000","last_active":"2024-09-10T11:41:09.625179+0000","last_peered":"2024-09-10T11:41:09.625179+0000","last_clean":"2024-09-10T11:41:09.625179+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:41:09.625179+0000","last_undegraded":"2024-09-10T11:41:09.625179+0000","last_fullsized":"2024-09-10T11:41:09.625179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:01:11.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.629118+0000","last_change":"2024-09-10T11:38:36.637533+0000","last_active":"2024-09-10T11:41:09.629118+0000","last_peered":"2024-09-10T11:41:09.629118+0000","last_clean":"2024-09-10T11:41:09.629118+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:41:09.629118+0000","last_undegraded":"2024-09-10T11:41:09.629118+0000","last_fullsized":"2024-09-10T11:41:09.629118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:00.658079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.630315+0000","last_change":"2024-09-10T11:38:35.639857+0000","last_active":"2024-09-10T11:41:04.630315+0000","last_peered":"2024-09-10T11:41:04.630315+0000","last_clean":"2024-09-10T11:41:04.630315+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:41:04.630315+0000","last_undegraded":"2024-09-10T11:41:04.630315+0000","last_fullsized":"2024-09-10T11:41:04.630315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624745+0000","last_change":"2024-09-10T11:38:35.640452+0000","last_active":"2024-09-10T11:41:04.624745+0000","last_peered":"2024-09-10T11:41:04.624745+0000","last_clean":"2024-09-10T11:41:04.624745+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:41:04.624745+0000","last_undegraded":"2024-09-10T11:41:04.624745+0000","last_fullsized":"2024-09-10T11:41:04.624745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.624715+0000","last_change":"2024-09-10T11:38:36.640142+0000","last_active":"2024-09-10T11:41:04.624715+0000","last_peered":"2024-09-10T11:41:04.624715+0000","last_clean":"2024-09-10T11:41:04.624715+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:41:04.624715+0000","last_undegraded":"2024-09-10T11:41:04.624715+0000","last_fullsized":"2024-09-10T11:41:04.624715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:21.253169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625081+0000","last_change":"2024-09-10T11:38:35.634293+0000","last_active":"2024-09-10T11:41:04.625081+0000","last_peered":"2024-09-10T11:41:04.625081+0000","last_clean":"2024-09-10T11:41:04.625081+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:41:04.625081+0000","last_undegraded":"2024-09-10T11:41:04.625081+0000","last_fullsized":"2024-09-10T11:41:04.625081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627391+0000","last_change":"2024-09-10T11:38:36.640108+0000","last_active":"2024-09-10T11:41:04.627391+0000","last_peered":"2024-09-10T11:41:04.627391+0000","last_clean":"2024-09-10T11:41:04.627391+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:41:04.627391+0000","last_undegraded":"2024-09-10T11:41:04.627391+0000","last_fullsized":"2024-09-10T11:41:04.627391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:56.202506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629889+0000","last_change":"2024-09-10T11:38:35.636735+0000","last_active":"2024-09-10T11:40:59.629889+0000","last_peered":"2024-09-10T11:40:59.629889+0000","last_clean":"2024-09-10T11:40:59.629889+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:40:59.629889+0000","last_undegraded":"2024-09-10T11:40:59.629889+0000","last_fullsized":"2024-09-10T11:40:59.629889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625128+0000","last_change":"2024-09-10T11:38:36.643438+0000","last_active":"2024-09-10T11:41:04.625128+0000","last_peered":"2024-09-10T11:41:04.625128+0000","last_clean":"2024-09-10T11:41:04.625128+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:41:04.625128+0000","last_undegraded":"2024-09-10T11:41:04.625128+0000","last_fullsized":"2024-09-10T11:41:04.625128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:15.171895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.625143+0000","last_change":"2024-09-10T11:38:35.636769+0000","last_active":"2024-09-10T11:41:04.625143+0000","last_peered":"2024-09-10T11:41:04.625143+0000","last_clean":"2024-09-10T11:41:04.625143+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:41:04.625143+0000","last_undegraded":"2024-09-10T11:41:04.625143+0000","last_fullsized":"2024-09-10T11:41:04.625143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.628725+0000","last_change":"2024-09-10T11:38:36.641223+0000","last_active":"2024-09-10T11:41:04.628725+0000","last_peered":"2024-09-10T11:41:04.628725+0000","last_clean":"2024-09-10T11:41:04.628725+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:41:04.628725+0000","last_undegraded":"2024-09-10T11:41:04.628725+0000","last_fullsized":"2024-09-10T11:41:04.628725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:12.674017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.627434+0000","last_change":"2024-09-10T11:38:35.637015+0000","last_active":"2024-09-10T11:41:04.627434+0000","last_peered":"2024-09-10T11:41:04.627434+0000","last_clean":"2024-09-10T11:41:04.627434+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:41:04.627434+0000","last_undegraded":"2024-09-10T11:41:04.627434+0000","last_fullsized":"2024-09-10T11:41:04.627434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.621604+0000","last_change":"2024-09-10T11:38:36.642791+0000","last_active":"2024-09-10T11:40:59.621604+0000","last_peered":"2024-09-10T11:40:59.621604+0000","last_clean":"2024-09-10T11:40:59.621604+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:40:59.621604+0000","last_undegraded":"2024-09-10T11:40:59.621604+0000","last_fullsized":"2024-09-10T11:40:59.621604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:51.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629292+0000","last_change":"2024-09-10T11:38:35.642639+0000","last_active":"2024-09-10T11:40:54.629292+0000","last_peered":"2024-09-10T11:40:54.629292+0000","last_clean":"2024-09-10T11:40:54.629292+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:40:54.629292+0000","last_undegraded":"2024-09-10T11:40:54.629292+0000","last_fullsized":"2024-09-10T11:40:54.629292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:04.622743+0000","last_change":"2024-09-10T11:38:36.650086+0000","last_active":"2024-09-10T11:41:04.622743+0000","last_peered":"2024-09-10T11:41:04.622743+0000","last_clean":"2024-09-10T11:41:04.622743+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:41:04.622743+0000","last_undegraded":"2024-09-10T11:41:04.622743+0000","last_fullsized":"2024-09-10T11:41:04.622743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:29.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:53.835581+0000","last_change":"2024-09-10T11:43:53.835581+0000","last_active":"2024-09-10T11:43:53.835581+0000","last_peered":"2024-09-10T11:43:53.835581+0000","last_clean":"2024-09-10T11:43:53.835581+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:43:53.835581+0000","last_undegraded":"2024-09-10T11:43:53.835581+0000","last_fullsized":"2024-09-10T11:43:53.835581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-10T11:43:53.835479+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-10T11:43:53.835479+0000","last_clean_scrub_stamp":"2024-09-10T11:43:53.835479+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:47.477016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.628319+0000","last_change":"2024-09-10T11:38:36.644942+0000","last_active":"2024-09-10T11:40:59.628319+0000","last_peered":"2024-09-10T11:40:59.628319+0000","last_clean":"2024-09-10T11:40:59.628319+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:40:59.628319+0000","last_undegraded":"2024-09-10T11:40:59.628319+0000","last_fullsized":"2024-09-10T11:40:59.628319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:44.234748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.624605+0000","last_change":"2024-09-10T11:38:35.642735+0000","last_active":"2024-09-10T11:40:59.624605+0000","last_peered":"2024-09-10T11:40:59.624605+0000","last_clean":"2024-09-10T11:40:59.624605+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:40:59.624605+0000","last_undegraded":"2024-09-10T11:40:59.624605+0000","last_fullsized":"2024-09-10T11:40:59.624605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:21.262740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622311+0000","last_change":"2024-09-10T11:38:36.646239+0000","last_active":"2024-09-10T11:40:59.622311+0000","last_peered":"2024-09-10T11:40:59.622311+0000","last_clean":"2024-09-10T11:40:59.622311+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:40:59.622311+0000","last_undegraded":"2024-09-10T11:40:59.622311+0000","last_fullsized":"2024-09-10T11:40:59.622311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.629268+0000","last_change":"2024-09-10T11:38:35.634618+0000","last_active":"2024-09-10T11:40:54.629268+0000","last_peered":"2024-09-10T11:40:54.629268+0000","last_clean":"2024-09-10T11:40:54.629268+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:40:54.629268+0000","last_undegraded":"2024-09-10T11:40:54.629268+0000","last_fullsized":"2024-09-10T11:40:54.629268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.629850+0000","last_change":"2024-09-10T11:38:36.643423+0000","last_active":"2024-09-10T11:40:59.629850+0000","last_peered":"2024-09-10T11:40:59.629850+0000","last_clean":"2024-09-10T11:40:59.629850+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:40:59.629850+0000","last_undegraded":"2024-09-10T11:40:59.629850+0000","last_fullsized":"2024-09-10T11:40:59.629850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:44.859466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.625504+0000","last_change":"2024-09-10T11:38:35.634241+0000","last_active":"2024-09-10T11:40:59.625504+0000","last_peered":"2024-09-10T11:40:59.625504+0000","last_clean":"2024-09-10T11:40:59.625504+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:40:59.625504+0000","last_undegraded":"2024-09-10T11:40:59.625504+0000","last_fullsized":"2024-09-10T11:40:59.625504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:27.519724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:59.622290+0000","last_change":"2024-09-10T11:38:36.647479+0000","last_active":"2024-09-10T11:40:59.622290+0000","last_peered":"2024-09-10T11:40:59.622290+0000","last_clean":"2024-09-10T11:40:59.622290+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:40:59.622290+0000","last_undegraded":"2024-09-10T11:40:59.622290+0000","last_fullsized":"2024-09-10T11:40:59.622290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621204+0000","last_change":"2024-09-10T11:38:35.634453+0000","last_active":"2024-09-10T11:40:54.621204+0000","last_peered":"2024-09-10T11:40:54.621204+0000","last_clean":"2024-09-10T11:40:54.621204+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:40:54.621204+0000","last_undegraded":"2024-09-10T11:40:54.621204+0000","last_fullsized":"2024-09-10T11:40:54.621204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:50.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621928+0000","last_change":"2024-09-10T11:38:36.646273+0000","last_active":"2024-09-10T11:40:54.621928+0000","last_peered":"2024-09-10T11:40:54.621928+0000","last_clean":"2024-09-10T11:40:54.621928+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:40:54.621928+0000","last_undegraded":"2024-09-10T11:40:54.621928+0000","last_fullsized":"2024-09-10T11:40:54.621928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:27.397541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625183+0000","last_change":"2024-09-10T11:38:35.641594+0000","last_active":"2024-09-10T11:40:54.625183+0000","last_peered":"2024-09-10T11:40:54.625183+0000","last_clean":"2024-09-10T11:40:54.625183+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:40:54.625183+0000","last_undegraded":"2024-09-10T11:40:54.625183+0000","last_fullsized":"2024-09-10T11:40:54.625183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621937+0000","last_change":"2024-09-10T11:38:36.647371+0000","last_active":"2024-09-10T11:40:54.621937+0000","last_peered":"2024-09-10T11:40:54.621937+0000","last_clean":"2024-09-10T11:40:54.621937+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:40:54.621937+0000","last_undegraded":"2024-09-10T11:40:54.621937+0000","last_fullsized":"2024-09-10T11:40:54.621937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:02.541978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.626566+0000","last_change":"2024-09-10T11:38:35.631682+0000","last_active":"2024-09-10T11:40:54.626566+0000","last_peered":"2024-09-10T11:40:54.626566+0000","last_clean":"2024-09-10T11:40:54.626566+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:40:54.626566+0000","last_undegraded":"2024-09-10T11:40:54.626566+0000","last_fullsized":"2024-09-10T11:40:54.626566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:39.245679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.624181+0000","last_change":"2024-09-10T11:38:36.647790+0000","last_active":"2024-09-10T11:40:54.624181+0000","last_peered":"2024-09-10T11:40:54.624181+0000","last_clean":"2024-09-10T11:40:54.624181+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:40:54.624181+0000","last_undegraded":"2024-09-10T11:40:54.624181+0000","last_fullsized":"2024-09-10T11:40:54.624181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:10.162977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.625163+0000","last_change":"2024-09-10T11:38:35.636736+0000","last_active":"2024-09-10T11:40:54.625163+0000","last_peered":"2024-09-10T11:40:54.625163+0000","last_clean":"2024-09-10T11:40:54.625163+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:40:54.625163+0000","last_undegraded":"2024-09-10T11:40:54.625163+0000","last_fullsized":"2024-09-10T11:40:54.625163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:25.945311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621911+0000","last_change":"2024-09-10T11:39:18.205415+0000","last_active":"2024-09-10T11:40:54.621911+0000","last_peered":"2024-09-10T11:40:54.621911+0000","last_clean":"2024-09-10T11:40:54.621911+0000","last_became_active":"2024-09-10T11:39:18.205081+0000","last_became_peered":"2024-09-10T11:39:18.205081+0000","last_unstale":"2024-09-10T11:40:54.621911+0000","last_undegraded":"2024-09-10T11:40:54.621911+0000","last_fullsized":"2024-09-10T11:40:54.621911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:59:18.998412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:29.619750+0000","last_change":"2024-09-10T11:38:28.025367+0000","last_active":"2024-09-10T11:40:29.619750+0000","last_peered":"2024-09-10T11:40:29.619750+0000","last_clean":"2024-09-10T11:40:29.619750+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:40:29.619750+0000","last_undegraded":"2024-09-10T11:40:29.619750+0000","last_fullsized":"2024-09-10T11:40:29.619750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:26.486030+0000","last_clean_scrub_stamp":"2024-09-10T11:38:26.486030+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.692371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623219+0000","last_change":"2024-09-10T11:38:35.633085+0000","last_active":"2024-09-10T11:40:44.623219+0000","last_peered":"2024-09-10T11:40:44.623219+0000","last_clean":"2024-09-10T11:40:44.623219+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:40:44.623219+0000","last_undegraded":"2024-09-10T11:40:44.623219+0000","last_fullsized":"2024-09-10T11:40:44.623219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.622831+0000","last_change":"2024-09-10T11:38:36.645981+0000","last_active":"2024-09-10T11:40:44.622831+0000","last_peered":"2024-09-10T11:40:44.622831+0000","last_clean":"2024-09-10T11:40:44.622831+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:40:44.622831+0000","last_undegraded":"2024-09-10T11:40:44.622831+0000","last_fullsized":"2024-09-10T11:40:44.622831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:47.324518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.620590+0000","last_change":"2024-09-10T11:38:35.640508+0000","last_active":"2024-09-10T11:40:39.620590+0000","last_peered":"2024-09-10T11:40:39.620590+0000","last_clean":"2024-09-10T11:40:39.620590+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:40:39.620590+0000","last_undegraded":"2024-09-10T11:40:39.620590+0000","last_fullsized":"2024-09-10T11:40:39.620590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:05.276724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626782+0000","last_change":"2024-09-10T11:38:36.637611+0000","last_active":"2024-09-10T11:40:44.626782+0000","last_peered":"2024-09-10T11:40:44.626782+0000","last_clean":"2024-09-10T11:40:44.626782+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:40:44.626782+0000","last_undegraded":"2024-09-10T11:40:44.626782+0000","last_fullsized":"2024-09-10T11:40:44.626782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:28.526816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.624248+0000","last_change":"2024-09-10T11:38:35.642440+0000","last_active":"2024-09-10T11:40:44.624248+0000","last_peered":"2024-09-10T11:40:44.624248+0000","last_clean":"2024-09-10T11:40:44.624248+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:40:44.624248+0000","last_undegraded":"2024-09-10T11:40:44.624248+0000","last_fullsized":"2024-09-10T11:40:44.624248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:20.274128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.625159+0000","last_change":"2024-09-10T11:38:36.630434+0000","last_active":"2024-09-10T11:40:39.625159+0000","last_peered":"2024-09-10T11:40:39.625159+0000","last_clean":"2024-09-10T11:40:39.625159+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:40:39.625159+0000","last_undegraded":"2024-09-10T11:40:39.625159+0000","last_fullsized":"2024-09-10T11:40:39.625159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623205+0000","last_change":"2024-09-10T11:38:35.635110+0000","last_active":"2024-09-10T11:40:44.623205+0000","last_peered":"2024-09-10T11:40:44.623205+0000","last_clean":"2024-09-10T11:40:44.623205+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:40:44.623205+0000","last_undegraded":"2024-09-10T11:40:44.623205+0000","last_fullsized":"2024-09-10T11:40:44.623205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:03.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620398+0000","last_change":"2024-09-10T11:38:36.641656+0000","last_active":"2024-09-10T11:40:44.620398+0000","last_peered":"2024-09-10T11:40:44.620398+0000","last_clean":"2024-09-10T11:40:44.620398+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:40:44.620398+0000","last_undegraded":"2024-09-10T11:40:44.620398+0000","last_fullsized":"2024-09-10T11:40:44.620398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:04.733893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625693+0000","last_change":"2024-09-10T11:38:35.638727+0000","last_active":"2024-09-10T11:40:44.625693+0000","last_peered":"2024-09-10T11:40:44.625693+0000","last_clean":"2024-09-10T11:40:44.625693+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:40:44.625693+0000","last_undegraded":"2024-09-10T11:40:44.625693+0000","last_fullsized":"2024-09-10T11:40:44.625693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:59.230577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.623247+0000","last_change":"2024-09-10T11:38:36.647060+0000","last_active":"2024-09-10T11:40:44.623247+0000","last_peered":"2024-09-10T11:40:44.623247+0000","last_clean":"2024-09-10T11:40:44.623247+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:40:44.623247+0000","last_undegraded":"2024-09-10T11:40:44.623247+0000","last_fullsized":"2024-09-10T11:40:44.623247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:30.486561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.620999+0000","last_change":"2024-09-10T11:38:35.638859+0000","last_active":"2024-09-10T11:40:44.620999+0000","last_peered":"2024-09-10T11:40:44.620999+0000","last_clean":"2024-09-10T11:40:44.620999+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:40:44.620999+0000","last_undegraded":"2024-09-10T11:40:44.620999+0000","last_fullsized":"2024-09-10T11:40:44.620999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:35.699713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.625670+0000","last_change":"2024-09-10T11:38:36.633859+0000","last_active":"2024-09-10T11:40:44.625670+0000","last_peered":"2024-09-10T11:40:44.625670+0000","last_clean":"2024-09-10T11:40:44.625670+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:40:44.625670+0000","last_undegraded":"2024-09-10T11:40:44.625670+0000","last_fullsized":"2024-09-10T11:40:44.625670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626109+0000","last_change":"2024-09-10T11:38:35.640832+0000","last_active":"2024-09-10T11:40:49.626109+0000","last_peered":"2024-09-10T11:40:49.626109+0000","last_clean":"2024-09-10T11:40:49.626109+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:40:49.626109+0000","last_undegraded":"2024-09-10T11:40:49.626109+0000","last_fullsized":"2024-09-10T11:40:49.626109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623400+0000","last_change":"2024-09-10T11:38:36.650134+0000","last_active":"2024-09-10T11:40:49.623400+0000","last_peered":"2024-09-10T11:40:49.623400+0000","last_clean":"2024-09-10T11:40:49.623400+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:40:49.623400+0000","last_undegraded":"2024-09-10T11:40:49.623400+0000","last_fullsized":"2024-09-10T11:40:49.623400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:30.427662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.628559+0000","last_change":"2024-09-10T11:38:35.635715+0000","last_active":"2024-09-10T11:40:44.628559+0000","last_peered":"2024-09-10T11:40:44.628559+0000","last_clean":"2024-09-10T11:40:44.628559+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:40:44.628559+0000","last_undegraded":"2024-09-10T11:40:44.628559+0000","last_fullsized":"2024-09-10T11:40:44.628559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:36:03.575084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.627338+0000","last_change":"2024-09-10T11:38:36.643156+0000","last_active":"2024-09-10T11:40:49.627338+0000","last_peered":"2024-09-10T11:40:49.627338+0000","last_clean":"2024-09-10T11:40:49.627338+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:40:49.627338+0000","last_undegraded":"2024-09-10T11:40:49.627338+0000","last_fullsized":"2024-09-10T11:40:49.627338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:01.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.621460+0000","last_change":"2024-09-10T11:38:35.638847+0000","last_active":"2024-09-10T11:40:49.621460+0000","last_peered":"2024-09-10T11:40:49.621460+0000","last_clean":"2024-09-10T11:40:49.621460+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:40:49.621460+0000","last_undegraded":"2024-09-10T11:40:49.621460+0000","last_fullsized":"2024-09-10T11:40:49.621460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:01.094094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.620745+0000","last_change":"2024-09-10T11:38:36.634737+0000","last_active":"2024-09-10T11:40:49.620745+0000","last_peered":"2024-09-10T11:40:49.620745+0000","last_clean":"2024-09-10T11:40:49.620745+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:40:49.620745+0000","last_undegraded":"2024-09-10T11:40:49.620745+0000","last_fullsized":"2024-09-10T11:40:49.620745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:22.276692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626053+0000","last_change":"2024-09-10T11:38:35.633858+0000","last_active":"2024-09-10T11:40:49.626053+0000","last_peered":"2024-09-10T11:40:49.626053+0000","last_clean":"2024-09-10T11:40:49.626053+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:40:49.626053+0000","last_undegraded":"2024-09-10T11:40:49.626053+0000","last_fullsized":"2024-09-10T11:40:49.626053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.623309+0000","last_change":"2024-09-10T11:38:36.641201+0000","last_active":"2024-09-10T11:40:49.623309+0000","last_peered":"2024-09-10T11:40:49.623309+0000","last_clean":"2024-09-10T11:40:49.623309+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:40:49.623309+0000","last_undegraded":"2024-09-10T11:40:49.623309+0000","last_fullsized":"2024-09-10T11:40:49.623309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:31.679316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.626069+0000","last_change":"2024-09-10T11:38:35.642693+0000","last_active":"2024-09-10T11:40:49.626069+0000","last_peered":"2024-09-10T11:40:49.626069+0000","last_clean":"2024-09-10T11:40:49.626069+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:40:49.626069+0000","last_undegraded":"2024-09-10T11:40:49.626069+0000","last_fullsized":"2024-09-10T11:40:49.626069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.623833+0000","last_change":"2024-09-10T11:38:36.649279+0000","last_active":"2024-09-10T11:40:54.623833+0000","last_peered":"2024-09-10T11:40:54.623833+0000","last_clean":"2024-09-10T11:40:54.623833+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:40:54.623833+0000","last_undegraded":"2024-09-10T11:40:54.623833+0000","last_fullsized":"2024-09-10T11:40:54.623833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:31.008200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:54.621892+0000","last_change":"2024-09-10T11:38:35.639652+0000","last_active":"2024-09-10T11:40:54.621892+0000","last_peered":"2024-09-10T11:40:54.621892+0000","last_clean":"2024-09-10T11:40:54.621892+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:40:54.621892+0000","last_undegraded":"2024-09-10T11:40:54.621892+0000","last_fullsized":"2024-09-10T11:40:54.621892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:18.759997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:49.628879+0000","last_change":"2024-09-10T11:38:36.641250+0000","last_active":"2024-09-10T11:40:49.628879+0000","last_peered":"2024-09-10T11:40:49.628879+0000","last_clean":"2024-09-10T11:40:49.628879+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:40:49.628879+0000","last_undegraded":"2024-09-10T11:40:49.628879+0000","last_fullsized":"2024-09-10T11:40:49.628879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:11.590730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625564+0000","last_change":"2024-09-10T11:38:36.640483+0000","last_active":"2024-09-10T11:41:09.625564+0000","last_peered":"2024-09-10T11:41:09.625564+0000","last_clean":"2024-09-10T11:41:09.625564+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:41:09.625564+0000","last_undegraded":"2024-09-10T11:41:09.625564+0000","last_fullsized":"2024-09-10T11:41:09.625564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:32.185858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623159+0000","last_change":"2024-09-10T11:38:35.639944+0000","last_active":"2024-09-10T11:41:09.623159+0000","last_peered":"2024-09-10T11:41:09.623159+0000","last_clean":"2024-09-10T11:41:09.623159+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:41:09.623159+0000","last_undegraded":"2024-09-10T11:41:09.623159+0000","last_fullsized":"2024-09-10T11:41:09.623159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:29.389893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.625550+0000","last_change":"2024-09-10T11:38:36.644204+0000","last_active":"2024-09-10T11:41:09.625550+0000","last_peered":"2024-09-10T11:41:09.625550+0000","last_clean":"2024-09-10T11:41:09.625550+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:41:09.625550+0000","last_undegraded":"2024-09-10T11:41:09.625550+0000","last_fullsized":"2024-09-10T11:41:09.625550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:13.822310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623179+0000","last_change":"2024-09-10T11:38:35.640059+0000","last_active":"2024-09-10T11:41:09.623179+0000","last_peered":"2024-09-10T11:41:09.623179+0000","last_clean":"2024-09-10T11:41:09.623179+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:41:09.623179+0000","last_undegraded":"2024-09-10T11:41:09.623179+0000","last_fullsized":"2024-09-10T11:41:09.623179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:14.527574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626847+0000","last_change":"2024-09-10T11:38:36.641293+0000","last_active":"2024-09-10T11:40:44.626847+0000","last_peered":"2024-09-10T11:40:44.626847+0000","last_clean":"2024-09-10T11:40:44.626847+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:40:44.626847+0000","last_undegraded":"2024-09-10T11:40:44.626847+0000","last_fullsized":"2024-09-10T11:40:44.626847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:37.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622362+0000","last_change":"2024-09-10T11:38:35.640715+0000","last_active":"2024-09-10T11:40:39.622362+0000","last_peered":"2024-09-10T11:40:39.622362+0000","last_clean":"2024-09-10T11:40:39.622362+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:40:39.622362+0000","last_undegraded":"2024-09-10T11:40:39.622362+0000","last_fullsized":"2024-09-10T11:40:39.622362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:01.761485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:39.622337+0000","last_change":"2024-09-10T11:38:36.647083+0000","last_active":"2024-09-10T11:40:39.622337+0000","last_peered":"2024-09-10T11:40:39.622337+0000","last_clean":"2024-09-10T11:40:39.622337+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:40:39.622337+0000","last_undegraded":"2024-09-10T11:40:39.622337+0000","last_fullsized":"2024-09-10T11:40:39.622337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:14.041505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.626866+0000","last_change":"2024-09-10T11:38:35.636258+0000","last_active":"2024-09-10T11:40:44.626866+0000","last_peered":"2024-09-10T11:40:44.626866+0000","last_clean":"2024-09-10T11:40:44.626866+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:40:44.626866+0000","last_undegraded":"2024-09-10T11:40:44.626866+0000","last_fullsized":"2024-09-10T11:40:44.626866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:34.596301+0000","last_clean_scrub_stamp":"2024-09-10T11:38:34.596301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:51.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":678737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":87877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":87913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":87787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":249856,"data_stored":87947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":678793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:43:58.426 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.426 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.427 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.428 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.429 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.430 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.431 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.432 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T11:38:26.486030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.433 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.434 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.435 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.436 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.437 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.437 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.437 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-10T11:38:34.596301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:43:58.437 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T11:44:18.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:44:18.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 -- 172.21.15.57:0/2577212718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015dc60 msgr2=0x7fcf500d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:18.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 --2- 172.21.15.57:0/2577212718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015dc60 0x7fcf500d24a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf40005fd0 tx=0x7fcf4002a670 comp rx=0 tx=0).stop 2024-09-10T11:44:18.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 -- 172.21.15.57:0/2577212718 shutdown_connections 2024-09-10T11:44:18.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 --2- 172.21.15.57:0/2577212718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf500d45b0 0x7fcf500d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 --2- 172.21.15.57:0/2577212718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015dc60 0x7fcf500d24a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 -- 172.21.15.57:0/2577212718 >> 172.21.15.57:0/2577212718 conn(0x7fcf5009cf80 msgr2=0x7fcf500d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:18.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 -- 172.21.15.57:0/2577212718 shutdown_connections 2024-09-10T11:44:18.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.591+0000 7fcf561e2640 1 -- 172.21.15.57:0/2577212718 wait complete. 2024-09-10T11:44:18.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.592+0000 7fcf561e2640 1 Processor -- start 2024-09-10T11:44:18.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.592+0000 7fcf561e2640 1 -- start start 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf561e2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf500d45b0 0x7fcf501f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf561e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5015dc60 0x7fcf50156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf561e2640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 0x7fcf5015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf561e2640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500b8720 con 0x7fcf5015e040 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf561e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500d1ed0 con 0x7fcf5015dc60 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf4ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 0x7fcf5015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:18.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf4ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 0x7fcf5015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35442/0 (socket says 172.21.15.57:35442) 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf4ffff640 1 -- 172.21.15.57:0/3898643774 learned_addr learned my addr 172.21.15.57:0/3898643774 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf4effd640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5015dc60 0x7fcf50156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf561e2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcf50162120 con 0x7fcf500d45b0 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.593+0000 7fcf4f7fe640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf500d45b0 0x7fcf501f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf4ffff640 1 -- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf500d45b0 msgr2=0x7fcf501f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf4ffff640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf500d45b0 0x7fcf501f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf4ffff640 1 -- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5015dc60 msgr2=0x7fcf50156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf4ffff640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5015dc60 0x7fcf50156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf4ffff640 1 -- 172.21.15.57:0/3898643774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5015c420 con 0x7fcf5015e040 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf4ffff640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 0x7fcf5015bb20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c730 tx=0x7fcf4800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48003b70 con 0x7fcf5015e040 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf501f4550 con 0x7fcf5015e040 2024-09-10T11:44:18.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf48003d10 con 0x7fcf5015e040 2024-09-10T11:44:18.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480052d0 con 0x7fcf5015e040 2024-09-10T11:44:18.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.594+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf50156750 con 0x7fcf5015e040 2024-09-10T11:44:18.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.596+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf501625d0 con 0x7fcf5015e040 2024-09-10T11:44:18.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.596+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fcf48005470 con 0x7fcf5015e040 2024-09-10T11:44:18.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.597+0000 7fcf37fff640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcf3c0750a0 0x7fcf3c077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:18.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.597+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fcf480960d0 con 0x7fcf5015e040 2024-09-10T11:44:18.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.597+0000 7fcf4f7fe640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcf3c0750a0 0x7fcf3c077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:18.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.598+0000 7fcf4f7fe640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcf3c0750a0 0x7fcf3c077560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf40033000 tx=0x7fcf40004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:18.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.601+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fcf4805fce0 con 0x7fcf5015e040 2024-09-10T11:44:18.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.865+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf500b9630 con 0x7fcf3c0750a0 2024-09-10T11:44:18.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.872+0000 7fcf37fff640 1 -- 172.21.15.57:0/3898643774 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251876 (secure 0 0 0) 0x7fcf500b9630 con 0x7fcf3c0750a0 2024-09-10T11:44:18.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:44:18.877 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcf3c0750a0 msgr2=0x7fcf3c077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcf3c0750a0 0x7fcf3c077560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf40033000 tx=0x7fcf40004730 comp rx=0 tx=0).stop 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 msgr2=0x7fcf5015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 0x7fcf5015bb20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c730 tx=0x7fcf4800cb30 comp rx=0 tx=0).stop 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 shutdown_connections 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fcf3c0750a0 0x7fcf3c077560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5015e040 0x7fcf5015bb20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5015dc60 0x7fcf50156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 --2- 172.21.15.57:0/3898643774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf500d45b0 0x7fcf501f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:18.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 >> 172.21.15.57:0/3898643774 conn(0x7fcf5009cf80 msgr2=0x7fcf5006e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 shutdown_connections 2024-09-10T11:44:18.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:18.876+0000 7fcf561e2640 1 -- 172.21.15.57:0/3898643774 wait complete. 2024-09-10T11:44:18.891 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-10T11:44:18.256020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235944,"kb_used_data":3112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738776,"statfs":{"total":773094113280,"available":772852506624,"internally_reserved":0,"allocated":3186688,"data_stored":1887852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002374"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:40:44.621023+0000","last_change":"2024-09-10T11:38:36.645911+0000","last_active":"2024-09-10T11:40:44.621023+0000","last_peered":"2024-09-10T11:40:44.621023+0000","last_clean":"2024-09-10T11:40:44.621023+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:40:44.621023+0000","last_undegraded":"2024-09-10T11:40:44.621023+0000","last_fullsized":"2024-09-10T11:40:44.621023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:59:44.668290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.656642+0000","last_change":"2024-09-10T11:44:05.656642+0000","last_active":"2024-09-10T11:44:05.656642+0000","last_peered":"2024-09-10T11:44:05.656642+0000","last_clean":"2024-09-10T11:44:05.656642+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:44:05.656642+0000","last_undegraded":"2024-09-10T11:44:05.656642+0000","last_fullsized":"2024-09-10T11:44:05.656642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.656492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.656492+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.656492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:31.882413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.871032+0000","last_change":"2024-09-10T11:44:03.871032+0000","last_active":"2024-09-10T11:44:03.871032+0000","last_peered":"2024-09-10T11:44:03.871032+0000","last_clean":"2024-09-10T11:44:03.871032+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:44:03.871032+0000","last_undegraded":"2024-09-10T11:44:03.871032+0000","last_fullsized":"2024-09-10T11:44:03.871032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.870920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.870920+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.870920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:37.569707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:11.775410+0000","last_change":"2024-09-10T11:44:11.775410+0000","last_active":"2024-09-10T11:44:11.775410+0000","last_peered":"2024-09-10T11:44:11.775410+0000","last_clean":"2024-09-10T11:44:11.775410+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:44:11.775410+0000","last_undegraded":"2024-09-10T11:44:11.775410+0000","last_fullsized":"2024-09-10T11:44:11.775410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:11.775330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:11.775330+0000","last_clean_scrub_stamp":"2024-09-10T11:44:11.775330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:53.422733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:41:09.623143+0000","last_change":"2024-09-10T11:38:36.648027+0000","last_active":"2024-09-10T11:41:09.623143+0000","last_peered":"2024-09-10T11:41:09.623143+0000","last_clean":"2024-09-10T11:41:09.623143+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:41:09.623143+0000","last_undegraded":"2024-09-10T11:41:09.623143+0000","last_fullsized":"2024-09-10T11:41:09.623143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:38:35.610253+0000","last_clean_scrub_stamp":"2024-09-10T11:38:35.610253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:08.598842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:10.746361+0000","last_change":"2024-09-10T11:44:10.746361+0000","last_active":"2024-09-10T11:44:10.746361+0000","last_peered":"2024-09-10T11:44:10.746361+0000","last_clean":"2024-09-10T11:44:10.746361+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:44:10.746361+0000","last_undegraded":"2024-09-10T11:44:10.746361+0000","last_fullsized":"2024-09-10T11:44:10.746361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:10.746261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:10.746261+0000","last_clean_scrub_stamp":"2024-09-10T11:44:10.746261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:30.920383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:13.785682+0000","last_change":"2024-09-10T11:44:13.785682+0000","last_active":"2024-09-10T11:44:13.785682+0000","last_peered":"2024-09-10T11:44:13.785682+0000","last_clean":"2024-09-10T11:44:13.785682+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:44:13.785682+0000","last_undegraded":"2024-09-10T11:44:13.785682+0000","last_fullsized":"2024-09-10T11:44:13.785682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:13.785613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:13.785613+0000","last_clean_scrub_stamp":"2024-09-10T11:44:13.785613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:32.011792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.711643+0000","last_change":"2024-09-10T11:44:06.711643+0000","last_active":"2024-09-10T11:44:06.711643+0000","last_peered":"2024-09-10T11:44:06.711643+0000","last_clean":"2024-09-10T11:44:06.711643+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:44:06.711643+0000","last_undegraded":"2024-09-10T11:44:06.711643+0000","last_fullsized":"2024-09-10T11:44:06.711643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.711550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.711550+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.711550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:00.855658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:12.825625+0000","last_change":"2024-09-10T11:44:12.825625+0000","last_active":"2024-09-10T11:44:12.825625+0000","last_peered":"2024-09-10T11:44:12.825625+0000","last_clean":"2024-09-10T11:44:12.825625+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:44:12.825625+0000","last_undegraded":"2024-09-10T11:44:12.825625+0000","last_fullsized":"2024-09-10T11:44:12.825625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:12.825528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:12.825528+0000","last_clean_scrub_stamp":"2024-09-10T11:44:12.825528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:39.316875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:08.176596+0000","last_change":"2024-09-10T11:44:08.176596+0000","last_active":"2024-09-10T11:44:08.176596+0000","last_peered":"2024-09-10T11:44:08.176596+0000","last_clean":"2024-09-10T11:44:08.176596+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:44:08.176596+0000","last_undegraded":"2024-09-10T11:44:08.176596+0000","last_fullsized":"2024-09-10T11:44:08.176596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:08.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:08.176514+0000","last_clean_scrub_stamp":"2024-09-10T11:44:08.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:26.248024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:09.160301+0000","last_change":"2024-09-10T11:44:09.160301+0000","last_active":"2024-09-10T11:44:09.160301+0000","last_peered":"2024-09-10T11:44:09.160301+0000","last_clean":"2024-09-10T11:44:09.160301+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:44:09.160301+0000","last_undegraded":"2024-09-10T11:44:09.160301+0000","last_fullsized":"2024-09-10T11:44:09.160301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:09.160236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:09.160236+0000","last_clean_scrub_stamp":"2024-09-10T11:44:09.160236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:32.590323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.983748+0000","last_change":"2024-09-10T11:44:01.983748+0000","last_active":"2024-09-10T11:44:01.983748+0000","last_peered":"2024-09-10T11:44:01.983748+0000","last_clean":"2024-09-10T11:44:01.983748+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:44:01.983748+0000","last_undegraded":"2024-09-10T11:44:01.983748+0000","last_fullsized":"2024-09-10T11:44:01.983748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.983635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.983635+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.983635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:24.510075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.411369+0000","last_change":"2024-09-10T11:44:03.411323+0000","last_active":"2024-09-10T11:44:03.411369+0000","last_peered":"2024-09-10T11:44:03.411369+0000","last_clean":"2024-09-10T11:44:03.411369+0000","last_became_active":"2024-09-10T11:39:17.816727+0000","last_became_peered":"2024-09-10T11:39:17.816727+0000","last_unstale":"2024-09-10T11:44:03.411369+0000","last_undegraded":"2024-09-10T11:44:03.411369+0000","last_fullsized":"2024-09-10T11:44:03.411369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.411257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.411257+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.411257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:07.936633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.915621+0000","last_change":"2024-09-10T11:44:02.915621+0000","last_active":"2024-09-10T11:44:02.915621+0000","last_peered":"2024-09-10T11:44:02.915621+0000","last_clean":"2024-09-10T11:44:02.915621+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:44:02.915621+0000","last_undegraded":"2024-09-10T11:44:02.915621+0000","last_fullsized":"2024-09-10T11:44:02.915621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.915514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.915514+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.915514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:58.460564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.678012+0000","last_change":"2024-09-10T11:44:04.678012+0000","last_active":"2024-09-10T11:44:04.678012+0000","last_peered":"2024-09-10T11:44:04.678012+0000","last_clean":"2024-09-10T11:44:04.678012+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:44:04.678012+0000","last_undegraded":"2024-09-10T11:44:04.678012+0000","last_fullsized":"2024-09-10T11:44:04.678012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.677902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.677902+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.677902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:28.107989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:09.709196+0000","last_change":"2024-09-10T11:44:09.709196+0000","last_active":"2024-09-10T11:44:09.709196+0000","last_peered":"2024-09-10T11:44:09.709196+0000","last_clean":"2024-09-10T11:44:09.709196+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:44:09.709196+0000","last_undegraded":"2024-09-10T11:44:09.709196+0000","last_fullsized":"2024-09-10T11:44:09.709196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:09.709113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:09.709113+0000","last_clean_scrub_stamp":"2024-09-10T11:44:09.709113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:25.649488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:08.683209+0000","last_change":"2024-09-10T11:44:08.683209+0000","last_active":"2024-09-10T11:44:08.683209+0000","last_peered":"2024-09-10T11:44:08.683209+0000","last_clean":"2024-09-10T11:44:08.683209+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:44:08.683209+0000","last_undegraded":"2024-09-10T11:44:08.683209+0000","last_fullsized":"2024-09-10T11:44:08.683209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:08.683116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:08.683116+0000","last_clean_scrub_stamp":"2024-09-10T11:44:08.683116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:49.294072+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.453888+0000","last_change":"2024-09-10T11:44:02.453888+0000","last_active":"2024-09-10T11:44:02.453888+0000","last_peered":"2024-09-10T11:44:02.453888+0000","last_clean":"2024-09-10T11:44:02.453888+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:44:02.453888+0000","last_undegraded":"2024-09-10T11:44:02.453888+0000","last_fullsized":"2024-09-10T11:44:02.453888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.453806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.453806+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.453806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:56.153603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:11.796746+0000","last_change":"2024-09-10T11:44:11.796746+0000","last_active":"2024-09-10T11:44:11.796746+0000","last_peered":"2024-09-10T11:44:11.796746+0000","last_clean":"2024-09-10T11:44:11.796746+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:44:11.796746+0000","last_undegraded":"2024-09-10T11:44:11.796746+0000","last_fullsized":"2024-09-10T11:44:11.796746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:11.796650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:11.796650+0000","last_clean_scrub_stamp":"2024-09-10T11:44:11.796650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:33.909182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.148952+0000","last_change":"2024-09-10T11:44:07.148952+0000","last_active":"2024-09-10T11:44:07.148952+0000","last_peered":"2024-09-10T11:44:07.148952+0000","last_clean":"2024-09-10T11:44:07.148952+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:44:07.148952+0000","last_undegraded":"2024-09-10T11:44:07.148952+0000","last_fullsized":"2024-09-10T11:44:07.148952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.148884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.148884+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.148884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:02.693934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.500732+0000","last_change":"2024-09-10T11:44:01.500732+0000","last_active":"2024-09-10T11:44:01.500732+0000","last_peered":"2024-09-10T11:44:01.500732+0000","last_clean":"2024-09-10T11:44:01.500732+0000","last_became_active":"2024-09-10T11:39:17.816084+0000","last_became_peered":"2024-09-10T11:39:17.816084+0000","last_unstale":"2024-09-10T11:44:01.500732+0000","last_undegraded":"2024-09-10T11:44:01.500732+0000","last_fullsized":"2024-09-10T11:44:01.500732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.500657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.500657+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.500657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:06.923254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.489198+0000","last_change":"2024-09-10T11:44:00.489198+0000","last_active":"2024-09-10T11:44:00.489198+0000","last_peered":"2024-09-10T11:44:00.489198+0000","last_clean":"2024-09-10T11:44:00.489198+0000","last_became_active":"2024-09-10T11:39:17.814205+0000","last_became_peered":"2024-09-10T11:39:17.814205+0000","last_unstale":"2024-09-10T11:44:00.489198+0000","last_undegraded":"2024-09-10T11:44:00.489198+0000","last_fullsized":"2024-09-10T11:44:00.489198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.489113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.489113+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.489113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:05.847710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.735541+0000","last_change":"2024-09-10T11:44:04.735541+0000","last_active":"2024-09-10T11:44:04.735541+0000","last_peered":"2024-09-10T11:44:04.735541+0000","last_clean":"2024-09-10T11:44:04.735541+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:44:04.735541+0000","last_undegraded":"2024-09-10T11:44:04.735541+0000","last_fullsized":"2024-09-10T11:44:04.735541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.735432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.735432+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.735432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:49.579397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.699965+0000","last_change":"2024-09-10T11:44:07.699965+0000","last_active":"2024-09-10T11:44:07.699965+0000","last_peered":"2024-09-10T11:44:07.699965+0000","last_clean":"2024-09-10T11:44:07.699965+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:44:07.699965+0000","last_undegraded":"2024-09-10T11:44:07.699965+0000","last_fullsized":"2024-09-10T11:44:07.699965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.699863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.699863+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.699863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:52.765768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.743994+0000","last_change":"2024-09-10T11:44:07.743994+0000","last_active":"2024-09-10T11:44:07.743994+0000","last_peered":"2024-09-10T11:44:07.743994+0000","last_clean":"2024-09-10T11:44:07.743994+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:44:07.743994+0000","last_undegraded":"2024-09-10T11:44:07.743994+0000","last_fullsized":"2024-09-10T11:44:07.743994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.743863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.743863+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.743863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:25.007940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.100398+0000","last_change":"2024-09-10T11:44:06.100398+0000","last_active":"2024-09-10T11:44:06.100398+0000","last_peered":"2024-09-10T11:44:06.100398+0000","last_clean":"2024-09-10T11:44:06.100398+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:44:06.100398+0000","last_undegraded":"2024-09-10T11:44:06.100398+0000","last_fullsized":"2024-09-10T11:44:06.100398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.100337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.100337+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.100337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:02.448950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.669716+0000","last_change":"2024-09-10T11:44:03.669716+0000","last_active":"2024-09-10T11:44:03.669716+0000","last_peered":"2024-09-10T11:44:03.669716+0000","last_clean":"2024-09-10T11:44:03.669716+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:44:03.669716+0000","last_undegraded":"2024-09-10T11:44:03.669716+0000","last_fullsized":"2024-09-10T11:44:03.669716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.669605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.669605+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.669605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:37.368392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.773731+0000","last_change":"2024-09-10T11:44:03.773731+0000","last_active":"2024-09-10T11:44:03.773731+0000","last_peered":"2024-09-10T11:44:03.773731+0000","last_clean":"2024-09-10T11:44:03.773731+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:44:03.773731+0000","last_undegraded":"2024-09-10T11:44:03.773731+0000","last_fullsized":"2024-09-10T11:44:03.773731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.773618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.773618+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.773618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:29.999539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.868455+0000","last_change":"2024-09-10T11:44:01.868455+0000","last_active":"2024-09-10T11:44:01.868455+0000","last_peered":"2024-09-10T11:44:01.868455+0000","last_clean":"2024-09-10T11:44:01.868455+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:44:01.868455+0000","last_undegraded":"2024-09-10T11:44:01.868455+0000","last_fullsized":"2024-09-10T11:44:01.868455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.868298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.868298+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.868298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:58.216911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.726478+0000","last_change":"2024-09-10T11:44:06.726478+0000","last_active":"2024-09-10T11:44:06.726478+0000","last_peered":"2024-09-10T11:44:06.726478+0000","last_clean":"2024-09-10T11:44:06.726478+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:44:06.726478+0000","last_undegraded":"2024-09-10T11:44:06.726478+0000","last_fullsized":"2024-09-10T11:44:06.726478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.726384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.726384+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.726384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:01.329559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.518814+0000","last_change":"2024-09-10T11:43:59.518814+0000","last_active":"2024-09-10T11:43:59.518814+0000","last_peered":"2024-09-10T11:43:59.518814+0000","last_clean":"2024-09-10T11:43:59.518814+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:43:59.518814+0000","last_undegraded":"2024-09-10T11:43:59.518814+0000","last_fullsized":"2024-09-10T11:43:59.518814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.518728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.518728+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.518728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:37.693967+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.142091+0000","last_change":"2024-09-10T11:44:05.142091+0000","last_active":"2024-09-10T11:44:05.142091+0000","last_peered":"2024-09-10T11:44:05.142091+0000","last_clean":"2024-09-10T11:44:05.142091+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:44:05.142091+0000","last_undegraded":"2024-09-10T11:44:05.142091+0000","last_fullsized":"2024-09-10T11:44:05.142091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.142030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.142030+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.142030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:54.071210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.009232+0000","last_change":"2024-09-10T11:44:01.009232+0000","last_active":"2024-09-10T11:44:01.009232+0000","last_peered":"2024-09-10T11:44:01.009232+0000","last_clean":"2024-09-10T11:44:01.009232+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:44:01.009232+0000","last_undegraded":"2024-09-10T11:44:01.009232+0000","last_fullsized":"2024-09-10T11:44:01.009232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.009133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.009133+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.009133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:00.184088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.723439+0000","last_change":"2024-09-10T11:43:56.723439+0000","last_active":"2024-09-10T11:43:56.723439+0000","last_peered":"2024-09-10T11:43:56.723439+0000","last_clean":"2024-09-10T11:43:56.723439+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:43:56.723439+0000","last_undegraded":"2024-09-10T11:43:56.723439+0000","last_fullsized":"2024-09-10T11:43:56.723439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-10T11:43:56.723324+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-10T11:43:56.723324+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.723324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:08.276411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.840847+0000","last_change":"2024-09-10T11:43:58.840847+0000","last_active":"2024-09-10T11:43:58.840847+0000","last_peered":"2024-09-10T11:43:58.840847+0000","last_clean":"2024-09-10T11:43:58.840847+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:43:58.840847+0000","last_undegraded":"2024-09-10T11:43:58.840847+0000","last_fullsized":"2024-09-10T11:43:58.840847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.840718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.840718+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.840718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:10.393805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.157660+0000","last_change":"2024-09-10T11:44:03.157660+0000","last_active":"2024-09-10T11:44:03.157660+0000","last_peered":"2024-09-10T11:44:03.157660+0000","last_clean":"2024-09-10T11:44:03.157660+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:44:03.157660+0000","last_undegraded":"2024-09-10T11:44:03.157660+0000","last_fullsized":"2024-09-10T11:44:03.157660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-10T11:44:03.157587+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-10T11:44:03.157587+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.157587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:14.710674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.728646+0000","last_change":"2024-09-10T11:43:55.728646+0000","last_active":"2024-09-10T11:43:55.728646+0000","last_peered":"2024-09-10T11:43:55.728646+0000","last_clean":"2024-09-10T11:43:55.728646+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:43:55.728646+0000","last_undegraded":"2024-09-10T11:43:55.728646+0000","last_fullsized":"2024-09-10T11:43:55.728646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:55.728518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:55.728518+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.728518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.297742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.783781+0000","last_change":"2024-09-10T11:44:02.783781+0000","last_active":"2024-09-10T11:44:02.783781+0000","last_peered":"2024-09-10T11:44:02.783781+0000","last_clean":"2024-09-10T11:44:02.783781+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:44:02.783781+0000","last_undegraded":"2024-09-10T11:44:02.783781+0000","last_fullsized":"2024-09-10T11:44:02.783781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.783704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.783704+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.783704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:26.213792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.858513+0000","last_change":"2024-09-10T11:44:00.858513+0000","last_active":"2024-09-10T11:44:00.858513+0000","last_peered":"2024-09-10T11:44:00.858513+0000","last_clean":"2024-09-10T11:44:00.858513+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:44:00.858513+0000","last_undegraded":"2024-09-10T11:44:00.858513+0000","last_fullsized":"2024-09-10T11:44:00.858513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.858426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.858426+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.858426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:20.784124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.646305+0000","last_change":"2024-09-10T11:44:02.646305+0000","last_active":"2024-09-10T11:44:02.646305+0000","last_peered":"2024-09-10T11:44:02.646305+0000","last_clean":"2024-09-10T11:44:02.646305+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:44:02.646305+0000","last_undegraded":"2024-09-10T11:44:02.646305+0000","last_fullsized":"2024-09-10T11:44:02.646305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.646221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.646221+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.646221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:52.493988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.125711+0000","last_change":"2024-09-10T11:44:02.125711+0000","last_active":"2024-09-10T11:44:02.125711+0000","last_peered":"2024-09-10T11:44:02.125711+0000","last_clean":"2024-09-10T11:44:02.125711+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:44:02.125711+0000","last_undegraded":"2024-09-10T11:44:02.125711+0000","last_fullsized":"2024-09-10T11:44:02.125711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.125623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.125623+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.125623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:10.694848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.832329+0000","last_change":"2024-09-10T11:44:03.832329+0000","last_active":"2024-09-10T11:44:03.832329+0000","last_peered":"2024-09-10T11:44:03.832329+0000","last_clean":"2024-09-10T11:44:03.832329+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:44:03.832329+0000","last_undegraded":"2024-09-10T11:44:03.832329+0000","last_fullsized":"2024-09-10T11:44:03.832329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.832231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.832231+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.832231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:36.528781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.848518+0000","last_change":"2024-09-10T11:43:58.848518+0000","last_active":"2024-09-10T11:43:58.848518+0000","last_peered":"2024-09-10T11:43:58.848518+0000","last_clean":"2024-09-10T11:43:58.848518+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:43:58.848518+0000","last_undegraded":"2024-09-10T11:43:58.848518+0000","last_fullsized":"2024-09-10T11:43:58.848518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.848428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.848428+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.848428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:22.278516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.867405+0000","last_change":"2024-09-10T11:43:57.867405+0000","last_active":"2024-09-10T11:43:57.867405+0000","last_peered":"2024-09-10T11:43:57.867405+0000","last_clean":"2024-09-10T11:43:57.867405+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:43:57.867405+0000","last_undegraded":"2024-09-10T11:43:57.867405+0000","last_fullsized":"2024-09-10T11:43:57.867405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:57.867273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:57.867273+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.867273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:27.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.674031+0000","last_change":"2024-09-10T11:43:59.674031+0000","last_active":"2024-09-10T11:43:59.674031+0000","last_peered":"2024-09-10T11:43:59.674031+0000","last_clean":"2024-09-10T11:43:59.674031+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:43:59.674031+0000","last_undegraded":"2024-09-10T11:43:59.674031+0000","last_fullsized":"2024-09-10T11:43:59.674031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-09-10T11:43:59.673918+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-09-10T11:43:59.673918+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.673918+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:14.865850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.054003+0000","last_change":"2024-09-10T11:44:00.054003+0000","last_active":"2024-09-10T11:44:00.054003+0000","last_peered":"2024-09-10T11:44:00.054003+0000","last_clean":"2024-09-10T11:44:00.054003+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:44:00.054003+0000","last_undegraded":"2024-09-10T11:44:00.054003+0000","last_fullsized":"2024-09-10T11:44:00.054003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.053918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.053918+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.053918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:19.411354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.190857+0000","last_change":"2024-09-10T11:43:58.190857+0000","last_active":"2024-09-10T11:43:58.190857+0000","last_peered":"2024-09-10T11:43:58.190857+0000","last_clean":"2024-09-10T11:43:58.190857+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:43:58.190857+0000","last_undegraded":"2024-09-10T11:43:58.190857+0000","last_fullsized":"2024-09-10T11:43:58.190857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-09-10T11:43:58.190775+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-09-10T11:43:58.190775+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.190775+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:51.832311+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:10.782035+0000","last_change":"2024-09-10T11:44:10.782035+0000","last_active":"2024-09-10T11:44:10.782035+0000","last_peered":"2024-09-10T11:44:10.782035+0000","last_clean":"2024-09-10T11:44:10.782035+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:44:10.782035+0000","last_undegraded":"2024-09-10T11:44:10.782035+0000","last_fullsized":"2024-09-10T11:44:10.782035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:10.781918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:10.781918+0000","last_clean_scrub_stamp":"2024-09-10T11:44:10.781918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:30.956041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:53.835581+0000","last_change":"2024-09-10T11:43:53.835581+0000","last_active":"2024-09-10T11:43:53.835581+0000","last_peered":"2024-09-10T11:43:53.835581+0000","last_clean":"2024-09-10T11:43:53.835581+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:43:53.835581+0000","last_undegraded":"2024-09-10T11:43:53.835581+0000","last_fullsized":"2024-09-10T11:43:53.835581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-10T11:43:53.835479+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-10T11:43:53.835479+0000","last_clean_scrub_stamp":"2024-09-10T11:43:53.835479+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:47.477016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.862186+0000","last_change":"2024-09-10T11:43:59.862186+0000","last_active":"2024-09-10T11:43:59.862186+0000","last_peered":"2024-09-10T11:43:59.862186+0000","last_clean":"2024-09-10T11:43:59.862186+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:43:59.862186+0000","last_undegraded":"2024-09-10T11:43:59.862186+0000","last_fullsized":"2024-09-10T11:43:59.862186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.862025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.862025+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.862025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:44.952171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.876381+0000","last_change":"2024-09-10T11:43:59.876381+0000","last_active":"2024-09-10T11:43:59.876381+0000","last_peered":"2024-09-10T11:43:59.876381+0000","last_clean":"2024-09-10T11:43:59.876381+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:43:59.876381+0000","last_undegraded":"2024-09-10T11:43:59.876381+0000","last_fullsized":"2024-09-10T11:43:59.876381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.876283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.876283+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.876283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:26.102203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:09.828675+0000","last_change":"2024-09-10T11:44:09.828675+0000","last_active":"2024-09-10T11:44:09.828675+0000","last_peered":"2024-09-10T11:44:09.828675+0000","last_clean":"2024-09-10T11:44:09.828675+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:44:09.828675+0000","last_undegraded":"2024-09-10T11:44:09.828675+0000","last_fullsized":"2024-09-10T11:44:09.828675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:09.828600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:09.828600+0000","last_clean_scrub_stamp":"2024-09-10T11:44:09.828600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:25.768976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.169732+0000","last_change":"2024-09-10T11:44:00.169732+0000","last_active":"2024-09-10T11:44:00.169732+0000","last_peered":"2024-09-10T11:44:00.169732+0000","last_clean":"2024-09-10T11:44:00.169732+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:44:00.169732+0000","last_undegraded":"2024-09-10T11:44:00.169732+0000","last_fullsized":"2024-09-10T11:44:00.169732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.169616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.169616+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.169616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:24.396811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.158286+0000","last_change":"2024-09-10T11:44:01.158286+0000","last_active":"2024-09-10T11:44:01.158286+0000","last_peered":"2024-09-10T11:44:01.158286+0000","last_clean":"2024-09-10T11:44:01.158286+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:44:01.158286+0000","last_undegraded":"2024-09-10T11:44:01.158286+0000","last_fullsized":"2024-09-10T11:44:01.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.158218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.158218+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.158218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:17.839735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.490571+0000","last_change":"2024-09-10T11:43:58.490571+0000","last_active":"2024-09-10T11:43:58.490571+0000","last_peered":"2024-09-10T11:43:58.490571+0000","last_clean":"2024-09-10T11:43:58.490571+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:43:58.490571+0000","last_undegraded":"2024-09-10T11:43:58.490571+0000","last_fullsized":"2024-09-10T11:43:58.490571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-09-10T11:43:58.490467+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-09-10T11:43:58.490467+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.490467+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:34.236520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:08.865585+0000","last_change":"2024-09-10T11:44:08.865585+0000","last_active":"2024-09-10T11:44:08.865585+0000","last_peered":"2024-09-10T11:44:08.865585+0000","last_clean":"2024-09-10T11:44:08.865585+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:44:08.865585+0000","last_undegraded":"2024-09-10T11:44:08.865585+0000","last_fullsized":"2024-09-10T11:44:08.865585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:08.865482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:08.865482+0000","last_clean_scrub_stamp":"2024-09-10T11:44:08.865482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:49.476437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.075047+0000","last_change":"2024-09-10T11:43:57.075047+0000","last_active":"2024-09-10T11:43:57.075047+0000","last_peered":"2024-09-10T11:43:57.075047+0000","last_clean":"2024-09-10T11:43:57.075047+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:43:57.075047+0000","last_undegraded":"2024-09-10T11:43:57.075047+0000","last_fullsized":"2024-09-10T11:43:57.075047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-10T11:43:57.074947+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-10T11:43:57.074947+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.074947+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:00.806560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.769046+0000","last_change":"2024-09-10T11:44:04.769046+0000","last_active":"2024-09-10T11:44:04.769046+0000","last_peered":"2024-09-10T11:44:04.769046+0000","last_clean":"2024-09-10T11:44:04.769046+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:44:04.769046+0000","last_undegraded":"2024-09-10T11:44:04.769046+0000","last_fullsized":"2024-09-10T11:44:04.769046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.768951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.768951+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.768951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:12.638754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.517072+0000","last_change":"2024-09-10T11:43:57.517072+0000","last_active":"2024-09-10T11:43:57.517072+0000","last_peered":"2024-09-10T11:43:57.517072+0000","last_clean":"2024-09-10T11:43:57.517072+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:43:57.517072+0000","last_undegraded":"2024-09-10T11:43:57.517072+0000","last_fullsized":"2024-09-10T11:43:57.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:43:57.516979+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:43:57.516979+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.516979+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:22.689533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.795111+0000","last_change":"2024-09-10T11:44:06.795111+0000","last_active":"2024-09-10T11:44:06.795111+0000","last_peered":"2024-09-10T11:44:06.795111+0000","last_clean":"2024-09-10T11:44:06.795111+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:44:06.795111+0000","last_undegraded":"2024-09-10T11:44:06.795111+0000","last_fullsized":"2024-09-10T11:44:06.795111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.795024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.795024+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.795024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:01.398199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.638585+0000","last_change":"2024-09-10T11:43:58.638585+0000","last_active":"2024-09-10T11:43:58.638585+0000","last_peered":"2024-09-10T11:43:58.638585+0000","last_clean":"2024-09-10T11:43:58.638585+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:43:58.638585+0000","last_undegraded":"2024-09-10T11:43:58.638585+0000","last_fullsized":"2024-09-10T11:43:58.638585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-10T11:43:58.638485+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-10T11:43:58.638485+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.638485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:07.207709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.863602+0000","last_change":"2024-09-10T11:44:02.863602+0000","last_active":"2024-09-10T11:44:02.863602+0000","last_peered":"2024-09-10T11:44:02.863602+0000","last_clean":"2024-09-10T11:44:02.863602+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:44:02.863602+0000","last_undegraded":"2024-09-10T11:44:02.863602+0000","last_fullsized":"2024-09-10T11:44:02.863602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.863502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.863502+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.863502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:16.459997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.565084+0000","last_change":"2024-09-10T11:43:56.565084+0000","last_active":"2024-09-10T11:43:56.565084+0000","last_peered":"2024-09-10T11:43:56.565084+0000","last_clean":"2024-09-10T11:43:56.565084+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:43:56.565084+0000","last_undegraded":"2024-09-10T11:43:56.565084+0000","last_fullsized":"2024-09-10T11:43:56.565084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.564989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.564989+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.564989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:30.302217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.844319+0000","last_change":"2024-09-10T11:44:07.844319+0000","last_active":"2024-09-10T11:44:07.844319+0000","last_peered":"2024-09-10T11:44:07.844319+0000","last_clean":"2024-09-10T11:44:07.844319+0000","last_became_active":"2024-09-10T11:39:18.205081+0000","last_became_peered":"2024-09-10T11:39:18.205081+0000","last_unstale":"2024-09-10T11:44:07.844319+0000","last_undegraded":"2024-09-10T11:44:07.844319+0000","last_fullsized":"2024-09-10T11:44:07.844319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.844220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.844220+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.844220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:52.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":127,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.728406+0000","last_change":"2024-09-10T11:43:58.728406+0000","last_active":"2024-09-10T11:43:58.728406+0000","last_peered":"2024-09-10T11:43:58.728406+0000","last_clean":"2024-09-10T11:43:58.728406+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:43:58.728406+0000","last_undegraded":"2024-09-10T11:43:58.728406+0000","last_fullsized":"2024-09-10T11:43:58.728406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-09-10T11:43:58.728299+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-09-10T11:43:58.728299+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.728299+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:24.954219+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.847210+0000","last_change":"2024-09-10T11:43:57.847210+0000","last_active":"2024-09-10T11:43:57.847210+0000","last_peered":"2024-09-10T11:43:57.847210+0000","last_clean":"2024-09-10T11:43:57.847210+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:43:57.847210+0000","last_undegraded":"2024-09-10T11:43:57.847210+0000","last_fullsized":"2024-09-10T11:43:57.847210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:57.847117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:57.847117+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.847117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:31.545904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.707314+0000","last_change":"2024-09-10T11:43:58.707314+0000","last_active":"2024-09-10T11:43:58.707314+0000","last_peered":"2024-09-10T11:43:58.707314+0000","last_clean":"2024-09-10T11:43:58.707314+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:43:58.707314+0000","last_undegraded":"2024-09-10T11:43:58.707314+0000","last_fullsized":"2024-09-10T11:43:58.707314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.707167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.707167+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.707167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:47.636348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.759406+0000","last_change":"2024-09-10T11:43:59.759406+0000","last_active":"2024-09-10T11:43:59.759406+0000","last_peered":"2024-09-10T11:43:59.759406+0000","last_clean":"2024-09-10T11:43:59.759406+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:43:59.759406+0000","last_undegraded":"2024-09-10T11:43:59.759406+0000","last_fullsized":"2024-09-10T11:43:59.759406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.759332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.759332+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.759332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:44.603297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.864660+0000","last_change":"2024-09-10T11:43:56.864660+0000","last_active":"2024-09-10T11:43:56.864660+0000","last_peered":"2024-09-10T11:43:56.864660+0000","last_clean":"2024-09-10T11:43:56.864660+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:43:56.864660+0000","last_undegraded":"2024-09-10T11:43:56.864660+0000","last_fullsized":"2024-09-10T11:43:56.864660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.864561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.864561+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.864561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:13.546077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.548239+0000","last_change":"2024-09-10T11:43:55.548239+0000","last_active":"2024-09-10T11:43:55.548239+0000","last_peered":"2024-09-10T11:43:55.548239+0000","last_clean":"2024-09-10T11:43:55.548239+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:43:55.548239+0000","last_undegraded":"2024-09-10T11:43:55.548239+0000","last_fullsized":"2024-09-10T11:43:55.548239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:55.548134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:55.548134+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.548134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:17.806653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.654608+0000","last_change":"2024-09-10T11:44:00.654608+0000","last_active":"2024-09-10T11:44:00.654608+0000","last_peered":"2024-09-10T11:44:00.654608+0000","last_clean":"2024-09-10T11:44:00.654608+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:44:00.654608+0000","last_undegraded":"2024-09-10T11:44:00.654608+0000","last_fullsized":"2024-09-10T11:44:00.654608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.654519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.654519+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.654519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:56.978099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.812824+0000","last_change":"2024-09-10T11:43:56.812824+0000","last_active":"2024-09-10T11:43:56.812824+0000","last_peered":"2024-09-10T11:43:56.812824+0000","last_clean":"2024-09-10T11:43:56.812824+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:43:56.812824+0000","last_undegraded":"2024-09-10T11:43:56.812824+0000","last_fullsized":"2024-09-10T11:43:56.812824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.812731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.812731+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.812731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:46.660498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.105196+0000","last_change":"2024-09-10T11:43:58.105196+0000","last_active":"2024-09-10T11:43:58.105196+0000","last_peered":"2024-09-10T11:43:58.105196+0000","last_clean":"2024-09-10T11:43:58.105196+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:43:58.105196+0000","last_undegraded":"2024-09-10T11:43:58.105196+0000","last_fullsized":"2024-09-10T11:43:58.105196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.105077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.105077+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.105077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:04.727805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:54.650587+0000","last_change":"2024-09-10T11:43:54.650587+0000","last_active":"2024-09-10T11:43:54.650587+0000","last_peered":"2024-09-10T11:43:54.650587+0000","last_clean":"2024-09-10T11:43:54.650587+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:43:54.650587+0000","last_undegraded":"2024-09-10T11:43:54.650587+0000","last_fullsized":"2024-09-10T11:43:54.650587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:54.650461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:54.650461+0000","last_clean_scrub_stamp":"2024-09-10T11:43:54.650461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:37:59.175837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.830812+0000","last_change":"2024-09-10T11:44:01.830812+0000","last_active":"2024-09-10T11:44:01.830812+0000","last_peered":"2024-09-10T11:44:01.830812+0000","last_clean":"2024-09-10T11:44:01.830812+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:44:01.830812+0000","last_undegraded":"2024-09-10T11:44:01.830812+0000","last_fullsized":"2024-09-10T11:44:01.830812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.830717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.830717+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.830717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:51.200037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.785559+0000","last_change":"2024-09-10T11:44:00.785559+0000","last_active":"2024-09-10T11:44:00.785559+0000","last_peered":"2024-09-10T11:44:00.785559+0000","last_clean":"2024-09-10T11:44:00.785559+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:44:00.785559+0000","last_undegraded":"2024-09-10T11:44:00.785559+0000","last_fullsized":"2024-09-10T11:44:00.785559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.785460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.785460+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.785460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:55.663041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.631352+0000","last_change":"2024-09-10T11:44:01.631352+0000","last_active":"2024-09-10T11:44:01.631352+0000","last_peered":"2024-09-10T11:44:01.631352+0000","last_clean":"2024-09-10T11:44:01.631352+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:44:01.631352+0000","last_undegraded":"2024-09-10T11:44:01.631352+0000","last_fullsized":"2024-09-10T11:44:01.631352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.631230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.631230+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.631230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:15.732944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.632468+0000","last_change":"2024-09-10T11:43:55.632468+0000","last_active":"2024-09-10T11:43:55.632468+0000","last_peered":"2024-09-10T11:43:55.632468+0000","last_clean":"2024-09-10T11:43:55.632468+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:43:55.632468+0000","last_undegraded":"2024-09-10T11:43:55.632468+0000","last_fullsized":"2024-09-10T11:43:55.632468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-10T11:43:55.632364+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-10T11:43:55.632364+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.632364+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:05:43.373865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.746066+0000","last_change":"2024-09-10T11:43:59.746066+0000","last_active":"2024-09-10T11:43:59.746066+0000","last_peered":"2024-09-10T11:43:59.746066+0000","last_clean":"2024-09-10T11:43:59.746066+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:43:59.746066+0000","last_undegraded":"2024-09-10T11:43:59.746066+0000","last_fullsized":"2024-09-10T11:43:59.746066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.745968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.745968+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.745968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:56.094580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.183067+0000","last_change":"2024-09-10T11:43:59.183067+0000","last_active":"2024-09-10T11:43:59.183067+0000","last_peered":"2024-09-10T11:43:59.183067+0000","last_clean":"2024-09-10T11:43:59.183067+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:43:59.183067+0000","last_undegraded":"2024-09-10T11:43:59.183067+0000","last_fullsized":"2024-09-10T11:43:59.183067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:43:59.183005+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:43:59.183005+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.183005+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:33.401436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.814724+0000","last_change":"2024-09-10T11:43:55.814724+0000","last_active":"2024-09-10T11:43:55.814724+0000","last_peered":"2024-09-10T11:43:55.814724+0000","last_clean":"2024-09-10T11:43:55.814724+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:43:55.814724+0000","last_undegraded":"2024-09-10T11:43:55.814724+0000","last_fullsized":"2024-09-10T11:43:55.814724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:55.814536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:55.814536+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.814536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:20.041731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.826393+0000","last_change":"2024-09-10T11:44:01.826393+0000","last_active":"2024-09-10T11:44:01.826393+0000","last_peered":"2024-09-10T11:44:01.826393+0000","last_clean":"2024-09-10T11:44:01.826393+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:44:01.826393+0000","last_undegraded":"2024-09-10T11:44:01.826393+0000","last_fullsized":"2024-09-10T11:44:01.826393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.826315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.826315+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.826315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:55.970422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.063373+0000","last_change":"2024-09-10T11:43:59.063373+0000","last_active":"2024-09-10T11:43:59.063373+0000","last_peered":"2024-09-10T11:43:59.063373+0000","last_clean":"2024-09-10T11:43:59.063373+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:43:59.063373+0000","last_undegraded":"2024-09-10T11:43:59.063373+0000","last_fullsized":"2024-09-10T11:43:59.063373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.063264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.063264+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.063264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:43.833777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.672529+0000","last_change":"2024-09-10T11:43:56.672529+0000","last_active":"2024-09-10T11:43:56.672529+0000","last_peered":"2024-09-10T11:43:56.672529+0000","last_clean":"2024-09-10T11:43:56.672529+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:43:56.672529+0000","last_undegraded":"2024-09-10T11:43:56.672529+0000","last_fullsized":"2024-09-10T11:43:56.672529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.672412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.672412+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.672412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:19.792381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.787841+0000","last_change":"2024-09-10T11:44:00.787841+0000","last_active":"2024-09-10T11:44:00.787841+0000","last_peered":"2024-09-10T11:44:00.787841+0000","last_clean":"2024-09-10T11:44:00.787841+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:44:00.787841+0000","last_undegraded":"2024-09-10T11:44:00.787841+0000","last_fullsized":"2024-09-10T11:44:00.787841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.787752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.787752+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.787752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:56.332803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.632174+0000","last_change":"2024-09-10T11:43:57.632174+0000","last_active":"2024-09-10T11:43:57.632174+0000","last_peered":"2024-09-10T11:43:57.632174+0000","last_clean":"2024-09-10T11:43:57.632174+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:43:57.632174+0000","last_undegraded":"2024-09-10T11:43:57.632174+0000","last_fullsized":"2024-09-10T11:43:57.632174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:57.632054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:57.632054+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.632054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:16.732088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.780720+0000","last_change":"2024-09-10T11:44:01.780720+0000","last_active":"2024-09-10T11:44:01.780720+0000","last_peered":"2024-09-10T11:44:01.780720+0000","last_clean":"2024-09-10T11:44:01.780720+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:44:01.780720+0000","last_undegraded":"2024-09-10T11:44:01.780720+0000","last_fullsized":"2024-09-10T11:44:01.780720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.780591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.780591+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.780591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:35.479378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.811680+0000","last_change":"2024-09-10T11:44:02.811680+0000","last_active":"2024-09-10T11:44:02.811680+0000","last_peered":"2024-09-10T11:44:02.811680+0000","last_clean":"2024-09-10T11:44:02.811680+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:44:02.811680+0000","last_undegraded":"2024-09-10T11:44:02.811680+0000","last_fullsized":"2024-09-10T11:44:02.811680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:44:02.811608+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:44:02.811608+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.811608+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:16.408103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.125016+0000","last_change":"2024-09-10T11:44:04.125016+0000","last_active":"2024-09-10T11:44:04.125016+0000","last_peered":"2024-09-10T11:44:04.125016+0000","last_clean":"2024-09-10T11:44:04.125016+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:44:04.125016+0000","last_undegraded":"2024-09-10T11:44:04.125016+0000","last_fullsized":"2024-09-10T11:44:04.125016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.124926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.124926+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.124926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:49.215073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.758444+0000","last_change":"2024-09-10T11:44:05.758444+0000","last_active":"2024-09-10T11:44:05.758444+0000","last_peered":"2024-09-10T11:44:05.758444+0000","last_clean":"2024-09-10T11:44:05.758444+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:44:05.758444+0000","last_undegraded":"2024-09-10T11:44:05.758444+0000","last_fullsized":"2024-09-10T11:44:05.758444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.758347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.758347+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.758347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.762477+0000","last_change":"2024-09-10T11:44:03.762477+0000","last_active":"2024-09-10T11:44:03.762477+0000","last_peered":"2024-09-10T11:44:03.762477+0000","last_clean":"2024-09-10T11:44:03.762477+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:44:03.762477+0000","last_undegraded":"2024-09-10T11:44:03.762477+0000","last_fullsized":"2024-09-10T11:44:03.762477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:44:03.762409+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:44:03.762409+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.762409+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.062987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.788512+0000","last_change":"2024-09-10T11:44:04.788512+0000","last_active":"2024-09-10T11:44:04.788512+0000","last_peered":"2024-09-10T11:44:04.788512+0000","last_clean":"2024-09-10T11:44:04.788512+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:44:04.788512+0000","last_undegraded":"2024-09-10T11:44:04.788512+0000","last_fullsized":"2024-09-10T11:44:04.788512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.788439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.788439+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.788439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:12.658241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.769479+0000","last_change":"2024-09-10T11:44:05.769479+0000","last_active":"2024-09-10T11:44:05.769479+0000","last_peered":"2024-09-10T11:44:05.769479+0000","last_clean":"2024-09-10T11:44:05.769479+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:44:05.769479+0000","last_undegraded":"2024-09-10T11:44:05.769479+0000","last_fullsized":"2024-09-10T11:44:05.769479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:44:05.769400+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:44:05.769400+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.769400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.831134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.864440+0000","last_change":"2024-09-10T11:44:00.864440+0000","last_active":"2024-09-10T11:44:00.864440+0000","last_peered":"2024-09-10T11:44:00.864440+0000","last_clean":"2024-09-10T11:44:00.864440+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:44:00.864440+0000","last_undegraded":"2024-09-10T11:44:00.864440+0000","last_fullsized":"2024-09-10T11:44:00.864440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.864322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.864322+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.864322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:49.793502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.691288+0000","last_change":"2024-09-10T11:43:57.691288+0000","last_active":"2024-09-10T11:43:57.691288+0000","last_peered":"2024-09-10T11:43:57.691288+0000","last_clean":"2024-09-10T11:43:57.691288+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:43:57.691288+0000","last_undegraded":"2024-09-10T11:43:57.691288+0000","last_fullsized":"2024-09-10T11:43:57.691288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-10T11:43:57.691153+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-10T11:43:57.691153+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.691153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:42.781299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.730380+0000","last_change":"2024-09-10T11:44:05.730380+0000","last_active":"2024-09-10T11:44:05.730380+0000","last_peered":"2024-09-10T11:44:05.730380+0000","last_clean":"2024-09-10T11:44:05.730380+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:44:05.730380+0000","last_undegraded":"2024-09-10T11:44:05.730380+0000","last_fullsized":"2024-09-10T11:44:05.730380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.730274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.730274+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.730274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:00.607855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:54.848082+0000","last_change":"2024-09-10T11:43:54.848082+0000","last_active":"2024-09-10T11:43:54.848082+0000","last_peered":"2024-09-10T11:43:54.848082+0000","last_clean":"2024-09-10T11:43:54.848082+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:43:54.848082+0000","last_undegraded":"2024-09-10T11:43:54.848082+0000","last_fullsized":"2024-09-10T11:43:54.848082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-10T11:43:54.847961+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-10T11:43:54.847961+0000","last_clean_scrub_stamp":"2024-09-10T11:43:54.847961+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:29.066391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":678737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":87877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":87913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":87787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":249856,"data_stored":87947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":678793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:44:18.896 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:44:18.896 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T11:38:35.610253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=38, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=11, tm_min=43, tm_sec=52, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T11:44:18.897 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T11:44:38.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.034+0000 7fd916271640 1 -- 172.21.15.57:0/2898865270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015dc60 msgr2=0x7fd9100d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.034+0000 7fd916271640 1 --2- 172.21.15.57:0/2898865270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015dc60 0x7fd9100d24a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd900009830 tx=0x7fd90002a5a0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.035+0000 7fd916271640 1 -- 172.21.15.57:0/2898865270 shutdown_connections 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.035+0000 7fd916271640 1 --2- 172.21.15.57:0/2898865270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 0x7fd9100d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.035+0000 7fd916271640 1 --2- 172.21.15.57:0/2898865270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015dc60 0x7fd9100d24a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.035+0000 7fd916271640 1 -- 172.21.15.57:0/2898865270 >> 172.21.15.57:0/2898865270 conn(0x7fd91009cf80 msgr2=0x7fd9100d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.035+0000 7fd916271640 1 -- 172.21.15.57:0/2898865270 shutdown_connections 2024-09-10T11:44:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.035+0000 7fd916271640 1 -- 172.21.15.57:0/2898865270 wait complete. 2024-09-10T11:44:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.036+0000 7fd916271640 1 Processor -- start 2024-09-10T11:44:39.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.036+0000 7fd916271640 1 -- start start 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.037+0000 7fd916271640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 0x7fd910156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.037+0000 7fd916271640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd91015dc60 0x7fd9100cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.037+0000 7fd916271640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015e040 0x7fd9100cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.037+0000 7fd916271640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100b8760 con 0x7fd91015dc60 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.037+0000 7fd916271640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100d1ed0 con 0x7fd91015e040 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.037+0000 7fd916271640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd910162120 con 0x7fd9100d45b0 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 0x7fd910156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd91015dc60 0x7fd9100cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 0x7fd910156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.57:57514/0 (socket says 172.21.15.57:57514) 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90ffff640 1 -- 172.21.15.57:0/712833242 learned_addr learned my addr 172.21.15.57:0/712833242 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd91480e640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015e040 0x7fd9100cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 -- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 msgr2=0x7fd910156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 0x7fd910156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 -- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015e040 msgr2=0x7fd9100cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015e040 0x7fd9100cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 -- 172.21.15.57:0/712833242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9100c74e0 con 0x7fd91015dc60 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90f7fe640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd91015dc60 0x7fd9100cd4f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd90400ea20 tx=0x7fd90400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90400cd50 con 0x7fd91015dc60 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd904004020 con 0x7fd91015dc60 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904004450 con 0x7fd91015dc60 2024-09-10T11:44:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.038+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9101f80a0 con 0x7fd91015dc60 2024-09-10T11:44:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.039+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9101f8660 con 0x7fd91015dc60 2024-09-10T11:44:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.040+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91015d450 con 0x7fd91015dc60 2024-09-10T11:44:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.041+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7fd9040035f0 con 0x7fd91015dc60 2024-09-10T11:44:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.041+0000 7fd90cff9640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8fc0750a0 0x7fd8fc077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.042+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd904096c60 con 0x7fd91015dc60 2024-09-10T11:44:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.042+0000 7fd90ffff640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8fc0750a0 0x7fd8fc077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.042+0000 7fd90ffff640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8fc0750a0 0x7fd8fc077560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd9000095f0 tx=0x7fd900004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.047+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7fd91015d450 con 0x7fd91015dc60 2024-09-10T11:44:39.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.334+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 --> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9100c98f0 con 0x7fd8fc0750a0 2024-09-10T11:44:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.339+0000 7fd90cff9640 1 -- 172.21.15.57:0/712833242 <== mgr.4133 v2:172.21.15.154:6816/2487136894 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251876 (secure 0 0 0) 0x7fd9100c98f0 con 0x7fd8fc0750a0 2024-09-10T11:44:39.344 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-09-10T11:44:39.346 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-09-10T11:44:39.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8fc0750a0 msgr2=0x7fd8fc077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8fc0750a0 0x7fd8fc077560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd9000095f0 tx=0x7fd900004730 comp rx=0 tx=0).stop 2024-09-10T11:44:39.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd91015dc60 msgr2=0x7fd9100cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd91015dc60 0x7fd9100cd4f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd90400ea20 tx=0x7fd90400eee0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 shutdown_connections 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7fd8fc0750a0 0x7fd8fc077560 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd91015e040 0x7fd9100cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd91015dc60 0x7fd9100cd4f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 --2- 172.21.15.57:0/712833242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9100d45b0 0x7fd910156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 >> 172.21.15.57:0/712833242 conn(0x7fd91009cf80 msgr2=0x7fd91006e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 shutdown_connections 2024-09-10T11:44:39.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.343+0000 7fd916271640 1 -- 172.21.15.57:0/712833242 wait complete. 2024-09-10T11:44:39.357 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-10T11:44:38.259805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235944,"kb_used_data":3112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738776,"statfs":{"total":773094113280,"available":772852506624,"internally_reserved":0,"allocated":3186688,"data_stored":1887852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002445"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:15.815637+0000","last_change":"2024-09-10T11:44:15.815637+0000","last_active":"2024-09-10T11:44:15.815637+0000","last_peered":"2024-09-10T11:44:15.815637+0000","last_clean":"2024-09-10T11:44:15.815637+0000","last_became_active":"2024-09-10T11:38:36.645599+0000","last_became_peered":"2024-09-10T11:38:36.645599+0000","last_unstale":"2024-09-10T11:44:15.815637+0000","last_undegraded":"2024-09-10T11:44:15.815637+0000","last_fullsized":"2024-09-10T11:44:15.815637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:15.815556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:15.815556+0000","last_clean_scrub_stamp":"2024-09-10T11:44:15.815556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:45.272719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.656642+0000","last_change":"2024-09-10T11:44:05.656642+0000","last_active":"2024-09-10T11:44:05.656642+0000","last_peered":"2024-09-10T11:44:05.656642+0000","last_clean":"2024-09-10T11:44:05.656642+0000","last_became_active":"2024-09-10T11:38:36.638874+0000","last_became_peered":"2024-09-10T11:38:36.638874+0000","last_unstale":"2024-09-10T11:44:05.656642+0000","last_undegraded":"2024-09-10T11:44:05.656642+0000","last_fullsized":"2024-09-10T11:44:05.656642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.656492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.656492+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.656492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:31.882413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.871032+0000","last_change":"2024-09-10T11:44:03.871032+0000","last_active":"2024-09-10T11:44:03.871032+0000","last_peered":"2024-09-10T11:44:03.871032+0000","last_clean":"2024-09-10T11:44:03.871032+0000","last_became_active":"2024-09-10T11:38:36.639375+0000","last_became_peered":"2024-09-10T11:38:36.639375+0000","last_unstale":"2024-09-10T11:44:03.871032+0000","last_undegraded":"2024-09-10T11:44:03.871032+0000","last_fullsized":"2024-09-10T11:44:03.871032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.870920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.870920+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.870920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:37.569707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:11.775410+0000","last_change":"2024-09-10T11:44:11.775410+0000","last_active":"2024-09-10T11:44:11.775410+0000","last_peered":"2024-09-10T11:44:11.775410+0000","last_clean":"2024-09-10T11:44:11.775410+0000","last_became_active":"2024-09-10T11:38:36.651284+0000","last_became_peered":"2024-09-10T11:38:36.651284+0000","last_unstale":"2024-09-10T11:44:11.775410+0000","last_undegraded":"2024-09-10T11:44:11.775410+0000","last_fullsized":"2024-09-10T11:44:11.775410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:11.775330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:11.775330+0000","last_clean_scrub_stamp":"2024-09-10T11:44:11.775330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:53.422733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:14.784433+0000","last_change":"2024-09-10T11:44:14.784433+0000","last_active":"2024-09-10T11:44:14.784433+0000","last_peered":"2024-09-10T11:44:14.784433+0000","last_clean":"2024-09-10T11:44:14.784433+0000","last_became_active":"2024-09-10T11:38:36.647717+0000","last_became_peered":"2024-09-10T11:38:36.647717+0000","last_unstale":"2024-09-10T11:44:14.784433+0000","last_undegraded":"2024-09-10T11:44:14.784433+0000","last_fullsized":"2024-09-10T11:44:14.784433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:14.784329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:14.784329+0000","last_clean_scrub_stamp":"2024-09-10T11:44:14.784329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:31.823774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:10.746361+0000","last_change":"2024-09-10T11:44:10.746361+0000","last_active":"2024-09-10T11:44:10.746361+0000","last_peered":"2024-09-10T11:44:10.746361+0000","last_clean":"2024-09-10T11:44:10.746361+0000","last_became_active":"2024-09-10T11:38:36.641399+0000","last_became_peered":"2024-09-10T11:38:36.641399+0000","last_unstale":"2024-09-10T11:44:10.746361+0000","last_undegraded":"2024-09-10T11:44:10.746361+0000","last_fullsized":"2024-09-10T11:44:10.746361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:10.746261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:10.746261+0000","last_clean_scrub_stamp":"2024-09-10T11:44:10.746261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:30.920383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:13.785682+0000","last_change":"2024-09-10T11:44:13.785682+0000","last_active":"2024-09-10T11:44:13.785682+0000","last_peered":"2024-09-10T11:44:13.785682+0000","last_clean":"2024-09-10T11:44:13.785682+0000","last_became_active":"2024-09-10T11:38:36.649258+0000","last_became_peered":"2024-09-10T11:38:36.649258+0000","last_unstale":"2024-09-10T11:44:13.785682+0000","last_undegraded":"2024-09-10T11:44:13.785682+0000","last_fullsized":"2024-09-10T11:44:13.785682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:13.785613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:13.785613+0000","last_clean_scrub_stamp":"2024-09-10T11:44:13.785613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:32.011792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.711643+0000","last_change":"2024-09-10T11:44:06.711643+0000","last_active":"2024-09-10T11:44:06.711643+0000","last_peered":"2024-09-10T11:44:06.711643+0000","last_clean":"2024-09-10T11:44:06.711643+0000","last_became_active":"2024-09-10T11:38:36.639055+0000","last_became_peered":"2024-09-10T11:38:36.639055+0000","last_unstale":"2024-09-10T11:44:06.711643+0000","last_undegraded":"2024-09-10T11:44:06.711643+0000","last_fullsized":"2024-09-10T11:44:06.711643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.711550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.711550+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.711550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:00.855658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:12.825625+0000","last_change":"2024-09-10T11:44:12.825625+0000","last_active":"2024-09-10T11:44:12.825625+0000","last_peered":"2024-09-10T11:44:12.825625+0000","last_clean":"2024-09-10T11:44:12.825625+0000","last_became_active":"2024-09-10T11:38:36.652688+0000","last_became_peered":"2024-09-10T11:38:36.652688+0000","last_unstale":"2024-09-10T11:44:12.825625+0000","last_undegraded":"2024-09-10T11:44:12.825625+0000","last_fullsized":"2024-09-10T11:44:12.825625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:12.825528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:12.825528+0000","last_clean_scrub_stamp":"2024-09-10T11:44:12.825528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:39.316875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:08.176596+0000","last_change":"2024-09-10T11:44:08.176596+0000","last_active":"2024-09-10T11:44:08.176596+0000","last_peered":"2024-09-10T11:44:08.176596+0000","last_clean":"2024-09-10T11:44:08.176596+0000","last_became_active":"2024-09-10T11:38:36.644533+0000","last_became_peered":"2024-09-10T11:38:36.644533+0000","last_unstale":"2024-09-10T11:44:08.176596+0000","last_undegraded":"2024-09-10T11:44:08.176596+0000","last_fullsized":"2024-09-10T11:44:08.176596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:08.176514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:08.176514+0000","last_clean_scrub_stamp":"2024-09-10T11:44:08.176514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:26.248024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:09.160301+0000","last_change":"2024-09-10T11:44:09.160301+0000","last_active":"2024-09-10T11:44:09.160301+0000","last_peered":"2024-09-10T11:44:09.160301+0000","last_clean":"2024-09-10T11:44:09.160301+0000","last_became_active":"2024-09-10T11:38:36.643814+0000","last_became_peered":"2024-09-10T11:38:36.643814+0000","last_unstale":"2024-09-10T11:44:09.160301+0000","last_undegraded":"2024-09-10T11:44:09.160301+0000","last_fullsized":"2024-09-10T11:44:09.160301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:09.160236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:09.160236+0000","last_clean_scrub_stamp":"2024-09-10T11:44:09.160236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:32.590323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.983748+0000","last_change":"2024-09-10T11:44:01.983748+0000","last_active":"2024-09-10T11:44:01.983748+0000","last_peered":"2024-09-10T11:44:01.983748+0000","last_clean":"2024-09-10T11:44:01.983748+0000","last_became_active":"2024-09-10T11:38:36.643649+0000","last_became_peered":"2024-09-10T11:38:36.643649+0000","last_unstale":"2024-09-10T11:44:01.983748+0000","last_undegraded":"2024-09-10T11:44:01.983748+0000","last_fullsized":"2024-09-10T11:44:01.983748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.983635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.983635+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.983635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:24.510075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.411369+0000","last_change":"2024-09-10T11:44:03.411323+0000","last_active":"2024-09-10T11:44:03.411369+0000","last_peered":"2024-09-10T11:44:03.411369+0000","last_clean":"2024-09-10T11:44:03.411369+0000","last_became_active":"2024-09-10T11:39:17.816727+0000","last_became_peered":"2024-09-10T11:39:17.816727+0000","last_unstale":"2024-09-10T11:44:03.411369+0000","last_undegraded":"2024-09-10T11:44:03.411369+0000","last_fullsized":"2024-09-10T11:44:03.411369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.411257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.411257+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.411257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:07.936633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.915621+0000","last_change":"2024-09-10T11:44:02.915621+0000","last_active":"2024-09-10T11:44:02.915621+0000","last_peered":"2024-09-10T11:44:02.915621+0000","last_clean":"2024-09-10T11:44:02.915621+0000","last_became_active":"2024-09-10T11:38:36.642887+0000","last_became_peered":"2024-09-10T11:38:36.642887+0000","last_unstale":"2024-09-10T11:44:02.915621+0000","last_undegraded":"2024-09-10T11:44:02.915621+0000","last_fullsized":"2024-09-10T11:44:02.915621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.915514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.915514+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.915514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:58.460564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.678012+0000","last_change":"2024-09-10T11:44:04.678012+0000","last_active":"2024-09-10T11:44:04.678012+0000","last_peered":"2024-09-10T11:44:04.678012+0000","last_clean":"2024-09-10T11:44:04.678012+0000","last_became_active":"2024-09-10T11:38:36.629746+0000","last_became_peered":"2024-09-10T11:38:36.629746+0000","last_unstale":"2024-09-10T11:44:04.678012+0000","last_undegraded":"2024-09-10T11:44:04.678012+0000","last_fullsized":"2024-09-10T11:44:04.678012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.677902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.677902+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.677902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:28.107989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:09.709196+0000","last_change":"2024-09-10T11:44:09.709196+0000","last_active":"2024-09-10T11:44:09.709196+0000","last_peered":"2024-09-10T11:44:09.709196+0000","last_clean":"2024-09-10T11:44:09.709196+0000","last_became_active":"2024-09-10T11:38:36.642434+0000","last_became_peered":"2024-09-10T11:38:36.642434+0000","last_unstale":"2024-09-10T11:44:09.709196+0000","last_undegraded":"2024-09-10T11:44:09.709196+0000","last_fullsized":"2024-09-10T11:44:09.709196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:09.709113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:09.709113+0000","last_clean_scrub_stamp":"2024-09-10T11:44:09.709113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:25.649488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:08.683209+0000","last_change":"2024-09-10T11:44:08.683209+0000","last_active":"2024-09-10T11:44:08.683209+0000","last_peered":"2024-09-10T11:44:08.683209+0000","last_clean":"2024-09-10T11:44:08.683209+0000","last_became_active":"2024-09-10T11:38:36.644172+0000","last_became_peered":"2024-09-10T11:38:36.644172+0000","last_unstale":"2024-09-10T11:44:08.683209+0000","last_undegraded":"2024-09-10T11:44:08.683209+0000","last_fullsized":"2024-09-10T11:44:08.683209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:08.683116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:08.683116+0000","last_clean_scrub_stamp":"2024-09-10T11:44:08.683116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:49.294072+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.453888+0000","last_change":"2024-09-10T11:44:02.453888+0000","last_active":"2024-09-10T11:44:02.453888+0000","last_peered":"2024-09-10T11:44:02.453888+0000","last_clean":"2024-09-10T11:44:02.453888+0000","last_became_active":"2024-09-10T11:38:36.647368+0000","last_became_peered":"2024-09-10T11:38:36.647368+0000","last_unstale":"2024-09-10T11:44:02.453888+0000","last_undegraded":"2024-09-10T11:44:02.453888+0000","last_fullsized":"2024-09-10T11:44:02.453888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.453806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.453806+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.453806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:56.153603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:11.796746+0000","last_change":"2024-09-10T11:44:11.796746+0000","last_active":"2024-09-10T11:44:11.796746+0000","last_peered":"2024-09-10T11:44:11.796746+0000","last_clean":"2024-09-10T11:44:11.796746+0000","last_became_active":"2024-09-10T11:38:36.652562+0000","last_became_peered":"2024-09-10T11:38:36.652562+0000","last_unstale":"2024-09-10T11:44:11.796746+0000","last_undegraded":"2024-09-10T11:44:11.796746+0000","last_fullsized":"2024-09-10T11:44:11.796746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:11.796650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:11.796650+0000","last_clean_scrub_stamp":"2024-09-10T11:44:11.796650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:33.909182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.148952+0000","last_change":"2024-09-10T11:44:07.148952+0000","last_active":"2024-09-10T11:44:07.148952+0000","last_peered":"2024-09-10T11:44:07.148952+0000","last_clean":"2024-09-10T11:44:07.148952+0000","last_became_active":"2024-09-10T11:38:36.644145+0000","last_became_peered":"2024-09-10T11:38:36.644145+0000","last_unstale":"2024-09-10T11:44:07.148952+0000","last_undegraded":"2024-09-10T11:44:07.148952+0000","last_fullsized":"2024-09-10T11:44:07.148952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.148884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.148884+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.148884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:02.693934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.500732+0000","last_change":"2024-09-10T11:44:01.500732+0000","last_active":"2024-09-10T11:44:01.500732+0000","last_peered":"2024-09-10T11:44:01.500732+0000","last_clean":"2024-09-10T11:44:01.500732+0000","last_became_active":"2024-09-10T11:39:17.816084+0000","last_became_peered":"2024-09-10T11:39:17.816084+0000","last_unstale":"2024-09-10T11:44:01.500732+0000","last_undegraded":"2024-09-10T11:44:01.500732+0000","last_fullsized":"2024-09-10T11:44:01.500732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.500657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.500657+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.500657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:06.923254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.489198+0000","last_change":"2024-09-10T11:44:00.489198+0000","last_active":"2024-09-10T11:44:00.489198+0000","last_peered":"2024-09-10T11:44:00.489198+0000","last_clean":"2024-09-10T11:44:00.489198+0000","last_became_active":"2024-09-10T11:39:17.814205+0000","last_became_peered":"2024-09-10T11:39:17.814205+0000","last_unstale":"2024-09-10T11:44:00.489198+0000","last_undegraded":"2024-09-10T11:44:00.489198+0000","last_fullsized":"2024-09-10T11:44:00.489198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.489113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.489113+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.489113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:05.847710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.735541+0000","last_change":"2024-09-10T11:44:04.735541+0000","last_active":"2024-09-10T11:44:04.735541+0000","last_peered":"2024-09-10T11:44:04.735541+0000","last_clean":"2024-09-10T11:44:04.735541+0000","last_became_active":"2024-09-10T11:38:36.638078+0000","last_became_peered":"2024-09-10T11:38:36.638078+0000","last_unstale":"2024-09-10T11:44:04.735541+0000","last_undegraded":"2024-09-10T11:44:04.735541+0000","last_fullsized":"2024-09-10T11:44:04.735541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.735432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.735432+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.735432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:49.579397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.699965+0000","last_change":"2024-09-10T11:44:07.699965+0000","last_active":"2024-09-10T11:44:07.699965+0000","last_peered":"2024-09-10T11:44:07.699965+0000","last_clean":"2024-09-10T11:44:07.699965+0000","last_became_active":"2024-09-10T11:38:36.648365+0000","last_became_peered":"2024-09-10T11:38:36.648365+0000","last_unstale":"2024-09-10T11:44:07.699965+0000","last_undegraded":"2024-09-10T11:44:07.699965+0000","last_fullsized":"2024-09-10T11:44:07.699965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.699863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.699863+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.699863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:52.765768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.743994+0000","last_change":"2024-09-10T11:44:07.743994+0000","last_active":"2024-09-10T11:44:07.743994+0000","last_peered":"2024-09-10T11:44:07.743994+0000","last_clean":"2024-09-10T11:44:07.743994+0000","last_became_active":"2024-09-10T11:38:36.639179+0000","last_became_peered":"2024-09-10T11:38:36.639179+0000","last_unstale":"2024-09-10T11:44:07.743994+0000","last_undegraded":"2024-09-10T11:44:07.743994+0000","last_fullsized":"2024-09-10T11:44:07.743994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.743863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.743863+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.743863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:25.007940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.100398+0000","last_change":"2024-09-10T11:44:06.100398+0000","last_active":"2024-09-10T11:44:06.100398+0000","last_peered":"2024-09-10T11:44:06.100398+0000","last_clean":"2024-09-10T11:44:06.100398+0000","last_became_active":"2024-09-10T11:38:36.642731+0000","last_became_peered":"2024-09-10T11:38:36.642731+0000","last_unstale":"2024-09-10T11:44:06.100398+0000","last_undegraded":"2024-09-10T11:44:06.100398+0000","last_fullsized":"2024-09-10T11:44:06.100398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.100337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.100337+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.100337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:02.448950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.669716+0000","last_change":"2024-09-10T11:44:03.669716+0000","last_active":"2024-09-10T11:44:03.669716+0000","last_peered":"2024-09-10T11:44:03.669716+0000","last_clean":"2024-09-10T11:44:03.669716+0000","last_became_active":"2024-09-10T11:38:36.635998+0000","last_became_peered":"2024-09-10T11:38:36.635998+0000","last_unstale":"2024-09-10T11:44:03.669716+0000","last_undegraded":"2024-09-10T11:44:03.669716+0000","last_fullsized":"2024-09-10T11:44:03.669716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.669605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.669605+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.669605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:37.368392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.773731+0000","last_change":"2024-09-10T11:44:03.773731+0000","last_active":"2024-09-10T11:44:03.773731+0000","last_peered":"2024-09-10T11:44:03.773731+0000","last_clean":"2024-09-10T11:44:03.773731+0000","last_became_active":"2024-09-10T11:38:36.640553+0000","last_became_peered":"2024-09-10T11:38:36.640553+0000","last_unstale":"2024-09-10T11:44:03.773731+0000","last_undegraded":"2024-09-10T11:44:03.773731+0000","last_fullsized":"2024-09-10T11:44:03.773731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.773618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.773618+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.773618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:29.999539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.868455+0000","last_change":"2024-09-10T11:44:01.868455+0000","last_active":"2024-09-10T11:44:01.868455+0000","last_peered":"2024-09-10T11:44:01.868455+0000","last_clean":"2024-09-10T11:44:01.868455+0000","last_became_active":"2024-09-10T11:38:36.651264+0000","last_became_peered":"2024-09-10T11:38:36.651264+0000","last_unstale":"2024-09-10T11:44:01.868455+0000","last_undegraded":"2024-09-10T11:44:01.868455+0000","last_fullsized":"2024-09-10T11:44:01.868455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.868298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.868298+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.868298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:58.216911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.726478+0000","last_change":"2024-09-10T11:44:06.726478+0000","last_active":"2024-09-10T11:44:06.726478+0000","last_peered":"2024-09-10T11:44:06.726478+0000","last_clean":"2024-09-10T11:44:06.726478+0000","last_became_active":"2024-09-10T11:38:36.654233+0000","last_became_peered":"2024-09-10T11:38:36.654233+0000","last_unstale":"2024-09-10T11:44:06.726478+0000","last_undegraded":"2024-09-10T11:44:06.726478+0000","last_fullsized":"2024-09-10T11:44:06.726478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.726384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.726384+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.726384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:01.329559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.518814+0000","last_change":"2024-09-10T11:43:59.518814+0000","last_active":"2024-09-10T11:43:59.518814+0000","last_peered":"2024-09-10T11:43:59.518814+0000","last_clean":"2024-09-10T11:43:59.518814+0000","last_became_active":"2024-09-10T11:38:36.636280+0000","last_became_peered":"2024-09-10T11:38:36.636280+0000","last_unstale":"2024-09-10T11:43:59.518814+0000","last_undegraded":"2024-09-10T11:43:59.518814+0000","last_fullsized":"2024-09-10T11:43:59.518814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.518728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.518728+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.518728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:37.693967+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.142091+0000","last_change":"2024-09-10T11:44:05.142091+0000","last_active":"2024-09-10T11:44:05.142091+0000","last_peered":"2024-09-10T11:44:05.142091+0000","last_clean":"2024-09-10T11:44:05.142091+0000","last_became_active":"2024-09-10T11:38:36.649444+0000","last_became_peered":"2024-09-10T11:38:36.649444+0000","last_unstale":"2024-09-10T11:44:05.142091+0000","last_undegraded":"2024-09-10T11:44:05.142091+0000","last_fullsized":"2024-09-10T11:44:05.142091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.142030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.142030+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.142030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:54.071210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.009232+0000","last_change":"2024-09-10T11:44:01.009232+0000","last_active":"2024-09-10T11:44:01.009232+0000","last_peered":"2024-09-10T11:44:01.009232+0000","last_clean":"2024-09-10T11:44:01.009232+0000","last_became_active":"2024-09-10T11:38:36.631025+0000","last_became_peered":"2024-09-10T11:38:36.631025+0000","last_unstale":"2024-09-10T11:44:01.009232+0000","last_undegraded":"2024-09-10T11:44:01.009232+0000","last_fullsized":"2024-09-10T11:44:01.009232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.009133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.009133+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.009133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:00.184088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.723439+0000","last_change":"2024-09-10T11:43:56.723439+0000","last_active":"2024-09-10T11:43:56.723439+0000","last_peered":"2024-09-10T11:43:56.723439+0000","last_clean":"2024-09-10T11:43:56.723439+0000","last_became_active":"2024-09-10T11:38:35.641122+0000","last_became_peered":"2024-09-10T11:38:35.641122+0000","last_unstale":"2024-09-10T11:43:56.723439+0000","last_undegraded":"2024-09-10T11:43:56.723439+0000","last_fullsized":"2024-09-10T11:43:56.723439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-10T11:43:56.723324+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-10T11:43:56.723324+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.723324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:08.276411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.840847+0000","last_change":"2024-09-10T11:43:58.840847+0000","last_active":"2024-09-10T11:43:58.840847+0000","last_peered":"2024-09-10T11:43:58.840847+0000","last_clean":"2024-09-10T11:43:58.840847+0000","last_became_active":"2024-09-10T11:38:36.637164+0000","last_became_peered":"2024-09-10T11:38:36.637164+0000","last_unstale":"2024-09-10T11:43:58.840847+0000","last_undegraded":"2024-09-10T11:43:58.840847+0000","last_fullsized":"2024-09-10T11:43:58.840847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.840718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.840718+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.840718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:10.393805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.157660+0000","last_change":"2024-09-10T11:44:03.157660+0000","last_active":"2024-09-10T11:44:03.157660+0000","last_peered":"2024-09-10T11:44:03.157660+0000","last_clean":"2024-09-10T11:44:03.157660+0000","last_became_active":"2024-09-10T11:38:35.639579+0000","last_became_peered":"2024-09-10T11:38:35.639579+0000","last_unstale":"2024-09-10T11:44:03.157660+0000","last_undegraded":"2024-09-10T11:44:03.157660+0000","last_fullsized":"2024-09-10T11:44:03.157660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-10T11:44:03.157587+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-10T11:44:03.157587+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.157587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:14.710674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.728646+0000","last_change":"2024-09-10T11:43:55.728646+0000","last_active":"2024-09-10T11:43:55.728646+0000","last_peered":"2024-09-10T11:43:55.728646+0000","last_clean":"2024-09-10T11:43:55.728646+0000","last_became_active":"2024-09-10T11:38:35.640104+0000","last_became_peered":"2024-09-10T11:38:35.640104+0000","last_unstale":"2024-09-10T11:43:55.728646+0000","last_undegraded":"2024-09-10T11:43:55.728646+0000","last_fullsized":"2024-09-10T11:43:55.728646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:55.728518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:55.728518+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.728518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.297742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.783781+0000","last_change":"2024-09-10T11:44:02.783781+0000","last_active":"2024-09-10T11:44:02.783781+0000","last_peered":"2024-09-10T11:44:02.783781+0000","last_clean":"2024-09-10T11:44:02.783781+0000","last_became_active":"2024-09-10T11:38:36.638394+0000","last_became_peered":"2024-09-10T11:38:36.638394+0000","last_unstale":"2024-09-10T11:44:02.783781+0000","last_undegraded":"2024-09-10T11:44:02.783781+0000","last_fullsized":"2024-09-10T11:44:02.783781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.783704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.783704+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.783704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:26.213792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.858513+0000","last_change":"2024-09-10T11:44:00.858513+0000","last_active":"2024-09-10T11:44:00.858513+0000","last_peered":"2024-09-10T11:44:00.858513+0000","last_clean":"2024-09-10T11:44:00.858513+0000","last_became_active":"2024-09-10T11:38:35.633940+0000","last_became_peered":"2024-09-10T11:38:35.633940+0000","last_unstale":"2024-09-10T11:44:00.858513+0000","last_undegraded":"2024-09-10T11:44:00.858513+0000","last_fullsized":"2024-09-10T11:44:00.858513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.858426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.858426+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.858426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:20.784124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.646305+0000","last_change":"2024-09-10T11:44:02.646305+0000","last_active":"2024-09-10T11:44:02.646305+0000","last_peered":"2024-09-10T11:44:02.646305+0000","last_clean":"2024-09-10T11:44:02.646305+0000","last_became_active":"2024-09-10T11:38:36.639819+0000","last_became_peered":"2024-09-10T11:38:36.639819+0000","last_unstale":"2024-09-10T11:44:02.646305+0000","last_undegraded":"2024-09-10T11:44:02.646305+0000","last_fullsized":"2024-09-10T11:44:02.646305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.646221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.646221+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.646221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:52.493988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.125711+0000","last_change":"2024-09-10T11:44:02.125711+0000","last_active":"2024-09-10T11:44:02.125711+0000","last_peered":"2024-09-10T11:44:02.125711+0000","last_clean":"2024-09-10T11:44:02.125711+0000","last_became_active":"2024-09-10T11:38:35.636397+0000","last_became_peered":"2024-09-10T11:38:35.636397+0000","last_unstale":"2024-09-10T11:44:02.125711+0000","last_undegraded":"2024-09-10T11:44:02.125711+0000","last_fullsized":"2024-09-10T11:44:02.125711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.125623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.125623+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.125623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:10.694848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.832329+0000","last_change":"2024-09-10T11:44:03.832329+0000","last_active":"2024-09-10T11:44:03.832329+0000","last_peered":"2024-09-10T11:44:03.832329+0000","last_clean":"2024-09-10T11:44:03.832329+0000","last_became_active":"2024-09-10T11:38:36.643150+0000","last_became_peered":"2024-09-10T11:38:36.643150+0000","last_unstale":"2024-09-10T11:44:03.832329+0000","last_undegraded":"2024-09-10T11:44:03.832329+0000","last_fullsized":"2024-09-10T11:44:03.832329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:03.832231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:03.832231+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.832231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:36.528781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.848518+0000","last_change":"2024-09-10T11:43:58.848518+0000","last_active":"2024-09-10T11:43:58.848518+0000","last_peered":"2024-09-10T11:43:58.848518+0000","last_clean":"2024-09-10T11:43:58.848518+0000","last_became_active":"2024-09-10T11:38:35.636486+0000","last_became_peered":"2024-09-10T11:38:35.636486+0000","last_unstale":"2024-09-10T11:43:58.848518+0000","last_undegraded":"2024-09-10T11:43:58.848518+0000","last_fullsized":"2024-09-10T11:43:58.848518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.848428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.848428+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.848428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:22.278516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.867405+0000","last_change":"2024-09-10T11:43:57.867405+0000","last_active":"2024-09-10T11:43:57.867405+0000","last_peered":"2024-09-10T11:43:57.867405+0000","last_clean":"2024-09-10T11:43:57.867405+0000","last_became_active":"2024-09-10T11:38:36.640462+0000","last_became_peered":"2024-09-10T11:38:36.640462+0000","last_unstale":"2024-09-10T11:43:57.867405+0000","last_undegraded":"2024-09-10T11:43:57.867405+0000","last_fullsized":"2024-09-10T11:43:57.867405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:57.867273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:57.867273+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.867273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:27.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.674031+0000","last_change":"2024-09-10T11:43:59.674031+0000","last_active":"2024-09-10T11:43:59.674031+0000","last_peered":"2024-09-10T11:43:59.674031+0000","last_clean":"2024-09-10T11:43:59.674031+0000","last_became_active":"2024-09-10T11:38:35.636544+0000","last_became_peered":"2024-09-10T11:38:35.636544+0000","last_unstale":"2024-09-10T11:43:59.674031+0000","last_undegraded":"2024-09-10T11:43:59.674031+0000","last_fullsized":"2024-09-10T11:43:59.674031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-09-10T11:43:59.673918+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-09-10T11:43:59.673918+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.673918+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:14.865850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.054003+0000","last_change":"2024-09-10T11:44:00.054003+0000","last_active":"2024-09-10T11:44:00.054003+0000","last_peered":"2024-09-10T11:44:00.054003+0000","last_clean":"2024-09-10T11:44:00.054003+0000","last_became_active":"2024-09-10T11:38:36.642515+0000","last_became_peered":"2024-09-10T11:38:36.642515+0000","last_unstale":"2024-09-10T11:44:00.054003+0000","last_undegraded":"2024-09-10T11:44:00.054003+0000","last_fullsized":"2024-09-10T11:44:00.054003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.053918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.053918+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.053918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:19.411354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.190857+0000","last_change":"2024-09-10T11:43:58.190857+0000","last_active":"2024-09-10T11:43:58.190857+0000","last_peered":"2024-09-10T11:43:58.190857+0000","last_clean":"2024-09-10T11:43:58.190857+0000","last_became_active":"2024-09-10T11:38:35.642358+0000","last_became_peered":"2024-09-10T11:38:35.642358+0000","last_unstale":"2024-09-10T11:43:58.190857+0000","last_undegraded":"2024-09-10T11:43:58.190857+0000","last_fullsized":"2024-09-10T11:43:58.190857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-09-10T11:43:58.190775+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-09-10T11:43:58.190775+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.190775+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:51.832311+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:10.782035+0000","last_change":"2024-09-10T11:44:10.782035+0000","last_active":"2024-09-10T11:44:10.782035+0000","last_peered":"2024-09-10T11:44:10.782035+0000","last_clean":"2024-09-10T11:44:10.782035+0000","last_became_active":"2024-09-10T11:38:36.649776+0000","last_became_peered":"2024-09-10T11:38:36.649776+0000","last_unstale":"2024-09-10T11:44:10.782035+0000","last_undegraded":"2024-09-10T11:44:10.782035+0000","last_fullsized":"2024-09-10T11:44:10.782035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:10.781918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:10.781918+0000","last_clean_scrub_stamp":"2024-09-10T11:44:10.781918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:30.956041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:53.835581+0000","last_change":"2024-09-10T11:43:53.835581+0000","last_active":"2024-09-10T11:43:53.835581+0000","last_peered":"2024-09-10T11:43:53.835581+0000","last_clean":"2024-09-10T11:43:53.835581+0000","last_became_active":"2024-09-10T11:38:35.631844+0000","last_became_peered":"2024-09-10T11:38:35.631844+0000","last_unstale":"2024-09-10T11:43:53.835581+0000","last_undegraded":"2024-09-10T11:43:53.835581+0000","last_fullsized":"2024-09-10T11:43:53.835581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-09-10T11:43:53.835479+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-09-10T11:43:53.835479+0000","last_clean_scrub_stamp":"2024-09-10T11:43:53.835479+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:47.477016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.862186+0000","last_change":"2024-09-10T11:43:59.862186+0000","last_active":"2024-09-10T11:43:59.862186+0000","last_peered":"2024-09-10T11:43:59.862186+0000","last_clean":"2024-09-10T11:43:59.862186+0000","last_became_active":"2024-09-10T11:38:36.643599+0000","last_became_peered":"2024-09-10T11:38:36.643599+0000","last_unstale":"2024-09-10T11:43:59.862186+0000","last_undegraded":"2024-09-10T11:43:59.862186+0000","last_fullsized":"2024-09-10T11:43:59.862186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.862025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.862025+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.862025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:44.952171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.876381+0000","last_change":"2024-09-10T11:43:59.876381+0000","last_active":"2024-09-10T11:43:59.876381+0000","last_peered":"2024-09-10T11:43:59.876381+0000","last_clean":"2024-09-10T11:43:59.876381+0000","last_became_active":"2024-09-10T11:38:35.642401+0000","last_became_peered":"2024-09-10T11:38:35.642401+0000","last_unstale":"2024-09-10T11:43:59.876381+0000","last_undegraded":"2024-09-10T11:43:59.876381+0000","last_fullsized":"2024-09-10T11:43:59.876381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.876283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.876283+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.876283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:26.102203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:09.828675+0000","last_change":"2024-09-10T11:44:09.828675+0000","last_active":"2024-09-10T11:44:09.828675+0000","last_peered":"2024-09-10T11:44:09.828675+0000","last_clean":"2024-09-10T11:44:09.828675+0000","last_became_active":"2024-09-10T11:38:36.645808+0000","last_became_peered":"2024-09-10T11:38:36.645808+0000","last_unstale":"2024-09-10T11:44:09.828675+0000","last_undegraded":"2024-09-10T11:44:09.828675+0000","last_fullsized":"2024-09-10T11:44:09.828675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:09.828600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:09.828600+0000","last_clean_scrub_stamp":"2024-09-10T11:44:09.828600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:25.768976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.169732+0000","last_change":"2024-09-10T11:44:00.169732+0000","last_active":"2024-09-10T11:44:00.169732+0000","last_peered":"2024-09-10T11:44:00.169732+0000","last_clean":"2024-09-10T11:44:00.169732+0000","last_became_active":"2024-09-10T11:38:35.634342+0000","last_became_peered":"2024-09-10T11:38:35.634342+0000","last_unstale":"2024-09-10T11:44:00.169732+0000","last_undegraded":"2024-09-10T11:44:00.169732+0000","last_fullsized":"2024-09-10T11:44:00.169732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.169616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.169616+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.169616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:24.396811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.158286+0000","last_change":"2024-09-10T11:44:01.158286+0000","last_active":"2024-09-10T11:44:01.158286+0000","last_peered":"2024-09-10T11:44:01.158286+0000","last_clean":"2024-09-10T11:44:01.158286+0000","last_became_active":"2024-09-10T11:38:36.643113+0000","last_became_peered":"2024-09-10T11:38:36.643113+0000","last_unstale":"2024-09-10T11:44:01.158286+0000","last_undegraded":"2024-09-10T11:44:01.158286+0000","last_fullsized":"2024-09-10T11:44:01.158286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.158218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.158218+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.158218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:17.839735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.490571+0000","last_change":"2024-09-10T11:43:58.490571+0000","last_active":"2024-09-10T11:43:58.490571+0000","last_peered":"2024-09-10T11:43:58.490571+0000","last_clean":"2024-09-10T11:43:58.490571+0000","last_became_active":"2024-09-10T11:38:35.633937+0000","last_became_peered":"2024-09-10T11:38:35.633937+0000","last_unstale":"2024-09-10T11:43:58.490571+0000","last_undegraded":"2024-09-10T11:43:58.490571+0000","last_fullsized":"2024-09-10T11:43:58.490571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-09-10T11:43:58.490467+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-09-10T11:43:58.490467+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.490467+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:34.236520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:08.865585+0000","last_change":"2024-09-10T11:44:08.865585+0000","last_active":"2024-09-10T11:44:08.865585+0000","last_peered":"2024-09-10T11:44:08.865585+0000","last_clean":"2024-09-10T11:44:08.865585+0000","last_became_active":"2024-09-10T11:38:36.646640+0000","last_became_peered":"2024-09-10T11:38:36.646640+0000","last_unstale":"2024-09-10T11:44:08.865585+0000","last_undegraded":"2024-09-10T11:44:08.865585+0000","last_fullsized":"2024-09-10T11:44:08.865585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:08.865482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:08.865482+0000","last_clean_scrub_stamp":"2024-09-10T11:44:08.865482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:49.476437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.075047+0000","last_change":"2024-09-10T11:43:57.075047+0000","last_active":"2024-09-10T11:43:57.075047+0000","last_peered":"2024-09-10T11:43:57.075047+0000","last_clean":"2024-09-10T11:43:57.075047+0000","last_became_active":"2024-09-10T11:38:35.632395+0000","last_became_peered":"2024-09-10T11:38:35.632395+0000","last_unstale":"2024-09-10T11:43:57.075047+0000","last_undegraded":"2024-09-10T11:43:57.075047+0000","last_fullsized":"2024-09-10T11:43:57.075047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-10T11:43:57.074947+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-10T11:43:57.074947+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.074947+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:00.806560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.769046+0000","last_change":"2024-09-10T11:44:04.769046+0000","last_active":"2024-09-10T11:44:04.769046+0000","last_peered":"2024-09-10T11:44:04.769046+0000","last_clean":"2024-09-10T11:44:04.769046+0000","last_became_active":"2024-09-10T11:38:36.645832+0000","last_became_peered":"2024-09-10T11:38:36.645832+0000","last_unstale":"2024-09-10T11:44:04.769046+0000","last_undegraded":"2024-09-10T11:44:04.769046+0000","last_fullsized":"2024-09-10T11:44:04.769046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.768951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.768951+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.768951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:12.638754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.517072+0000","last_change":"2024-09-10T11:43:57.517072+0000","last_active":"2024-09-10T11:43:57.517072+0000","last_peered":"2024-09-10T11:43:57.517072+0000","last_clean":"2024-09-10T11:43:57.517072+0000","last_became_active":"2024-09-10T11:38:35.641219+0000","last_became_peered":"2024-09-10T11:38:35.641219+0000","last_unstale":"2024-09-10T11:43:57.517072+0000","last_undegraded":"2024-09-10T11:43:57.517072+0000","last_fullsized":"2024-09-10T11:43:57.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:43:57.516979+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:43:57.516979+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.516979+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:22.689533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:06.795111+0000","last_change":"2024-09-10T11:44:06.795111+0000","last_active":"2024-09-10T11:44:06.795111+0000","last_peered":"2024-09-10T11:44:06.795111+0000","last_clean":"2024-09-10T11:44:06.795111+0000","last_became_active":"2024-09-10T11:38:36.647096+0000","last_became_peered":"2024-09-10T11:38:36.647096+0000","last_unstale":"2024-09-10T11:44:06.795111+0000","last_undegraded":"2024-09-10T11:44:06.795111+0000","last_fullsized":"2024-09-10T11:44:06.795111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:06.795024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:06.795024+0000","last_clean_scrub_stamp":"2024-09-10T11:44:06.795024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:01.398199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.638585+0000","last_change":"2024-09-10T11:43:58.638585+0000","last_active":"2024-09-10T11:43:58.638585+0000","last_peered":"2024-09-10T11:43:58.638585+0000","last_clean":"2024-09-10T11:43:58.638585+0000","last_became_active":"2024-09-10T11:38:35.631378+0000","last_became_peered":"2024-09-10T11:38:35.631378+0000","last_unstale":"2024-09-10T11:43:58.638585+0000","last_undegraded":"2024-09-10T11:43:58.638585+0000","last_fullsized":"2024-09-10T11:43:58.638585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-10T11:43:58.638485+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-10T11:43:58.638485+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.638485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:07.207709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.863602+0000","last_change":"2024-09-10T11:44:02.863602+0000","last_active":"2024-09-10T11:44:02.863602+0000","last_peered":"2024-09-10T11:44:02.863602+0000","last_clean":"2024-09-10T11:44:02.863602+0000","last_became_active":"2024-09-10T11:38:36.647537+0000","last_became_peered":"2024-09-10T11:38:36.647537+0000","last_unstale":"2024-09-10T11:44:02.863602+0000","last_undegraded":"2024-09-10T11:44:02.863602+0000","last_fullsized":"2024-09-10T11:44:02.863602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:02.863502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:02.863502+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.863502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:16.459997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.565084+0000","last_change":"2024-09-10T11:43:56.565084+0000","last_active":"2024-09-10T11:43:56.565084+0000","last_peered":"2024-09-10T11:43:56.565084+0000","last_clean":"2024-09-10T11:43:56.565084+0000","last_became_active":"2024-09-10T11:38:35.636417+0000","last_became_peered":"2024-09-10T11:38:35.636417+0000","last_unstale":"2024-09-10T11:43:56.565084+0000","last_undegraded":"2024-09-10T11:43:56.565084+0000","last_fullsized":"2024-09-10T11:43:56.565084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.564989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.564989+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.564989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:30.302217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:07.844319+0000","last_change":"2024-09-10T11:44:07.844319+0000","last_active":"2024-09-10T11:44:07.844319+0000","last_peered":"2024-09-10T11:44:07.844319+0000","last_clean":"2024-09-10T11:44:07.844319+0000","last_became_active":"2024-09-10T11:39:18.205081+0000","last_became_peered":"2024-09-10T11:39:18.205081+0000","last_unstale":"2024-09-10T11:44:07.844319+0000","last_undegraded":"2024-09-10T11:44:07.844319+0000","last_fullsized":"2024-09-10T11:44:07.844319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:07.844220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:07.844220+0000","last_clean_scrub_stamp":"2024-09-10T11:44:07.844220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:52.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.728503+0000","last_change":"2024-09-10T11:43:58.728406+0000","last_active":"2024-09-10T11:43:58.728503+0000","last_peered":"2024-09-10T11:43:58.728503+0000","last_clean":"2024-09-10T11:43:58.728503+0000","last_became_active":"2024-09-10T11:38:28.022599+0000","last_became_peered":"2024-09-10T11:38:28.022599+0000","last_unstale":"2024-09-10T11:43:58.728503+0000","last_undegraded":"2024-09-10T11:43:58.728503+0000","last_fullsized":"2024-09-10T11:43:58.728503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-09-10T11:43:58.728299+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-09-10T11:43:58.728299+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.728299+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:11:24.954219+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.847210+0000","last_change":"2024-09-10T11:43:57.847210+0000","last_active":"2024-09-10T11:43:57.847210+0000","last_peered":"2024-09-10T11:43:57.847210+0000","last_clean":"2024-09-10T11:43:57.847210+0000","last_became_active":"2024-09-10T11:38:35.632770+0000","last_became_peered":"2024-09-10T11:38:35.632770+0000","last_unstale":"2024-09-10T11:43:57.847210+0000","last_undegraded":"2024-09-10T11:43:57.847210+0000","last_fullsized":"2024-09-10T11:43:57.847210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:57.847117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:57.847117+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.847117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:31.545904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.707314+0000","last_change":"2024-09-10T11:43:58.707314+0000","last_active":"2024-09-10T11:43:58.707314+0000","last_peered":"2024-09-10T11:43:58.707314+0000","last_clean":"2024-09-10T11:43:58.707314+0000","last_became_active":"2024-09-10T11:38:36.645670+0000","last_became_peered":"2024-09-10T11:38:36.645670+0000","last_unstale":"2024-09-10T11:43:58.707314+0000","last_undegraded":"2024-09-10T11:43:58.707314+0000","last_fullsized":"2024-09-10T11:43:58.707314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.707167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.707167+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.707167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:47.636348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.759406+0000","last_change":"2024-09-10T11:43:59.759406+0000","last_active":"2024-09-10T11:43:59.759406+0000","last_peered":"2024-09-10T11:43:59.759406+0000","last_clean":"2024-09-10T11:43:59.759406+0000","last_became_active":"2024-09-10T11:38:35.640230+0000","last_became_peered":"2024-09-10T11:38:35.640230+0000","last_unstale":"2024-09-10T11:43:59.759406+0000","last_undegraded":"2024-09-10T11:43:59.759406+0000","last_fullsized":"2024-09-10T11:43:59.759406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.759332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.759332+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.759332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:44.603297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.864660+0000","last_change":"2024-09-10T11:43:56.864660+0000","last_active":"2024-09-10T11:43:56.864660+0000","last_peered":"2024-09-10T11:43:56.864660+0000","last_clean":"2024-09-10T11:43:56.864660+0000","last_became_active":"2024-09-10T11:38:36.637226+0000","last_became_peered":"2024-09-10T11:38:36.637226+0000","last_unstale":"2024-09-10T11:43:56.864660+0000","last_undegraded":"2024-09-10T11:43:56.864660+0000","last_fullsized":"2024-09-10T11:43:56.864660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.864561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.864561+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.864561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:13.546077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.548239+0000","last_change":"2024-09-10T11:43:55.548239+0000","last_active":"2024-09-10T11:43:55.548239+0000","last_peered":"2024-09-10T11:43:55.548239+0000","last_clean":"2024-09-10T11:43:55.548239+0000","last_became_active":"2024-09-10T11:38:35.642127+0000","last_became_peered":"2024-09-10T11:38:35.642127+0000","last_unstale":"2024-09-10T11:43:55.548239+0000","last_undegraded":"2024-09-10T11:43:55.548239+0000","last_fullsized":"2024-09-10T11:43:55.548239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:55.548134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:55.548134+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.548134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:17.806653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.654608+0000","last_change":"2024-09-10T11:44:00.654608+0000","last_active":"2024-09-10T11:44:00.654608+0000","last_peered":"2024-09-10T11:44:00.654608+0000","last_clean":"2024-09-10T11:44:00.654608+0000","last_became_active":"2024-09-10T11:38:36.630082+0000","last_became_peered":"2024-09-10T11:38:36.630082+0000","last_unstale":"2024-09-10T11:44:00.654608+0000","last_undegraded":"2024-09-10T11:44:00.654608+0000","last_fullsized":"2024-09-10T11:44:00.654608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.654519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.654519+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.654519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:56.978099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.812824+0000","last_change":"2024-09-10T11:43:56.812824+0000","last_active":"2024-09-10T11:43:56.812824+0000","last_peered":"2024-09-10T11:43:56.812824+0000","last_clean":"2024-09-10T11:43:56.812824+0000","last_became_active":"2024-09-10T11:38:35.634745+0000","last_became_peered":"2024-09-10T11:38:35.634745+0000","last_unstale":"2024-09-10T11:43:56.812824+0000","last_undegraded":"2024-09-10T11:43:56.812824+0000","last_fullsized":"2024-09-10T11:43:56.812824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.812731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.812731+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.812731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:46.660498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:58.105196+0000","last_change":"2024-09-10T11:43:58.105196+0000","last_active":"2024-09-10T11:43:58.105196+0000","last_peered":"2024-09-10T11:43:58.105196+0000","last_clean":"2024-09-10T11:43:58.105196+0000","last_became_active":"2024-09-10T11:38:36.641401+0000","last_became_peered":"2024-09-10T11:38:36.641401+0000","last_unstale":"2024-09-10T11:43:58.105196+0000","last_undegraded":"2024-09-10T11:43:58.105196+0000","last_fullsized":"2024-09-10T11:43:58.105196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:58.105077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:58.105077+0000","last_clean_scrub_stamp":"2024-09-10T11:43:58.105077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:27:04.727805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:54.650587+0000","last_change":"2024-09-10T11:43:54.650587+0000","last_active":"2024-09-10T11:43:54.650587+0000","last_peered":"2024-09-10T11:43:54.650587+0000","last_clean":"2024-09-10T11:43:54.650587+0000","last_became_active":"2024-09-10T11:38:35.638035+0000","last_became_peered":"2024-09-10T11:38:35.638035+0000","last_unstale":"2024-09-10T11:43:54.650587+0000","last_undegraded":"2024-09-10T11:43:54.650587+0000","last_fullsized":"2024-09-10T11:43:54.650587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:54.650461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:54.650461+0000","last_clean_scrub_stamp":"2024-09-10T11:43:54.650461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:37:59.175837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.830812+0000","last_change":"2024-09-10T11:44:01.830812+0000","last_active":"2024-09-10T11:44:01.830812+0000","last_peered":"2024-09-10T11:44:01.830812+0000","last_clean":"2024-09-10T11:44:01.830812+0000","last_became_active":"2024-09-10T11:38:36.646768+0000","last_became_peered":"2024-09-10T11:38:36.646768+0000","last_unstale":"2024-09-10T11:44:01.830812+0000","last_undegraded":"2024-09-10T11:44:01.830812+0000","last_fullsized":"2024-09-10T11:44:01.830812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.830717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.830717+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.830717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:51.200037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.785559+0000","last_change":"2024-09-10T11:44:00.785559+0000","last_active":"2024-09-10T11:44:00.785559+0000","last_peered":"2024-09-10T11:44:00.785559+0000","last_clean":"2024-09-10T11:44:00.785559+0000","last_became_active":"2024-09-10T11:38:35.638538+0000","last_became_peered":"2024-09-10T11:38:35.638538+0000","last_unstale":"2024-09-10T11:44:00.785559+0000","last_undegraded":"2024-09-10T11:44:00.785559+0000","last_fullsized":"2024-09-10T11:44:00.785559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.785460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.785460+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.785460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:55.663041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.631352+0000","last_change":"2024-09-10T11:44:01.631352+0000","last_active":"2024-09-10T11:44:01.631352+0000","last_peered":"2024-09-10T11:44:01.631352+0000","last_clean":"2024-09-10T11:44:01.631352+0000","last_became_active":"2024-09-10T11:38:36.630278+0000","last_became_peered":"2024-09-10T11:38:36.630278+0000","last_unstale":"2024-09-10T11:44:01.631352+0000","last_undegraded":"2024-09-10T11:44:01.631352+0000","last_fullsized":"2024-09-10T11:44:01.631352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.631230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.631230+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.631230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:15.732944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.632468+0000","last_change":"2024-09-10T11:43:55.632468+0000","last_active":"2024-09-10T11:43:55.632468+0000","last_peered":"2024-09-10T11:43:55.632468+0000","last_clean":"2024-09-10T11:43:55.632468+0000","last_became_active":"2024-09-10T11:38:35.640525+0000","last_became_peered":"2024-09-10T11:38:35.640525+0000","last_unstale":"2024-09-10T11:43:55.632468+0000","last_undegraded":"2024-09-10T11:43:55.632468+0000","last_fullsized":"2024-09-10T11:43:55.632468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-09-10T11:43:55.632364+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-09-10T11:43:55.632364+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.632364+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:05:43.373865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.746066+0000","last_change":"2024-09-10T11:43:59.746066+0000","last_active":"2024-09-10T11:43:59.746066+0000","last_peered":"2024-09-10T11:43:59.746066+0000","last_clean":"2024-09-10T11:43:59.746066+0000","last_became_active":"2024-09-10T11:38:36.649807+0000","last_became_peered":"2024-09-10T11:38:36.649807+0000","last_unstale":"2024-09-10T11:43:59.746066+0000","last_undegraded":"2024-09-10T11:43:59.746066+0000","last_fullsized":"2024-09-10T11:43:59.746066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.745968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.745968+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.745968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:56.094580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.183067+0000","last_change":"2024-09-10T11:43:59.183067+0000","last_active":"2024-09-10T11:43:59.183067+0000","last_peered":"2024-09-10T11:43:59.183067+0000","last_clean":"2024-09-10T11:43:59.183067+0000","last_became_active":"2024-09-10T11:38:35.635392+0000","last_became_peered":"2024-09-10T11:38:35.635392+0000","last_unstale":"2024-09-10T11:43:59.183067+0000","last_undegraded":"2024-09-10T11:43:59.183067+0000","last_fullsized":"2024-09-10T11:43:59.183067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:43:59.183005+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:43:59.183005+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.183005+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:33.401436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:55.814724+0000","last_change":"2024-09-10T11:43:55.814724+0000","last_active":"2024-09-10T11:43:55.814724+0000","last_peered":"2024-09-10T11:43:55.814724+0000","last_clean":"2024-09-10T11:43:55.814724+0000","last_became_active":"2024-09-10T11:38:36.642868+0000","last_became_peered":"2024-09-10T11:38:36.642868+0000","last_unstale":"2024-09-10T11:43:55.814724+0000","last_undegraded":"2024-09-10T11:43:55.814724+0000","last_fullsized":"2024-09-10T11:43:55.814724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:55.814536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:55.814536+0000","last_clean_scrub_stamp":"2024-09-10T11:43:55.814536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:20.041731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.826393+0000","last_change":"2024-09-10T11:44:01.826393+0000","last_active":"2024-09-10T11:44:01.826393+0000","last_peered":"2024-09-10T11:44:01.826393+0000","last_clean":"2024-09-10T11:44:01.826393+0000","last_became_active":"2024-09-10T11:38:35.638547+0000","last_became_peered":"2024-09-10T11:38:35.638547+0000","last_unstale":"2024-09-10T11:44:01.826393+0000","last_undegraded":"2024-09-10T11:44:01.826393+0000","last_fullsized":"2024-09-10T11:44:01.826393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.826315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.826315+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.826315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:55.970422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:59.063373+0000","last_change":"2024-09-10T11:43:59.063373+0000","last_active":"2024-09-10T11:43:59.063373+0000","last_peered":"2024-09-10T11:43:59.063373+0000","last_clean":"2024-09-10T11:43:59.063373+0000","last_became_active":"2024-09-10T11:38:36.634465+0000","last_became_peered":"2024-09-10T11:38:36.634465+0000","last_unstale":"2024-09-10T11:43:59.063373+0000","last_undegraded":"2024-09-10T11:43:59.063373+0000","last_fullsized":"2024-09-10T11:43:59.063373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:59.063264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:59.063264+0000","last_clean_scrub_stamp":"2024-09-10T11:43:59.063264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:43.833777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:56.672529+0000","last_change":"2024-09-10T11:43:56.672529+0000","last_active":"2024-09-10T11:43:56.672529+0000","last_peered":"2024-09-10T11:43:56.672529+0000","last_clean":"2024-09-10T11:43:56.672529+0000","last_became_active":"2024-09-10T11:38:35.633488+0000","last_became_peered":"2024-09-10T11:38:35.633488+0000","last_unstale":"2024-09-10T11:43:56.672529+0000","last_undegraded":"2024-09-10T11:43:56.672529+0000","last_fullsized":"2024-09-10T11:43:56.672529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:56.672412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:56.672412+0000","last_clean_scrub_stamp":"2024-09-10T11:43:56.672412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:19.792381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.787841+0000","last_change":"2024-09-10T11:44:00.787841+0000","last_active":"2024-09-10T11:44:00.787841+0000","last_peered":"2024-09-10T11:44:00.787841+0000","last_clean":"2024-09-10T11:44:00.787841+0000","last_became_active":"2024-09-10T11:38:36.640142+0000","last_became_peered":"2024-09-10T11:38:36.640142+0000","last_unstale":"2024-09-10T11:44:00.787841+0000","last_undegraded":"2024-09-10T11:44:00.787841+0000","last_fullsized":"2024-09-10T11:44:00.787841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.787752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.787752+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.787752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:56.332803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.632174+0000","last_change":"2024-09-10T11:43:57.632174+0000","last_active":"2024-09-10T11:43:57.632174+0000","last_peered":"2024-09-10T11:43:57.632174+0000","last_clean":"2024-09-10T11:43:57.632174+0000","last_became_active":"2024-09-10T11:38:35.642388+0000","last_became_peered":"2024-09-10T11:38:35.642388+0000","last_unstale":"2024-09-10T11:43:57.632174+0000","last_undegraded":"2024-09-10T11:43:57.632174+0000","last_fullsized":"2024-09-10T11:43:57.632174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:43:57.632054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:43:57.632054+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.632054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:16.732088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:01.780720+0000","last_change":"2024-09-10T11:44:01.780720+0000","last_active":"2024-09-10T11:44:01.780720+0000","last_peered":"2024-09-10T11:44:01.780720+0000","last_clean":"2024-09-10T11:44:01.780720+0000","last_became_active":"2024-09-10T11:38:36.646729+0000","last_became_peered":"2024-09-10T11:38:36.646729+0000","last_unstale":"2024-09-10T11:44:01.780720+0000","last_undegraded":"2024-09-10T11:44:01.780720+0000","last_fullsized":"2024-09-10T11:44:01.780720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:01.780591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:01.780591+0000","last_clean_scrub_stamp":"2024-09-10T11:44:01.780591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:35.479378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:02.811680+0000","last_change":"2024-09-10T11:44:02.811680+0000","last_active":"2024-09-10T11:44:02.811680+0000","last_peered":"2024-09-10T11:44:02.811680+0000","last_clean":"2024-09-10T11:44:02.811680+0000","last_became_active":"2024-09-10T11:38:35.639350+0000","last_became_peered":"2024-09-10T11:38:35.639350+0000","last_unstale":"2024-09-10T11:44:02.811680+0000","last_undegraded":"2024-09-10T11:44:02.811680+0000","last_fullsized":"2024-09-10T11:44:02.811680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:44:02.811608+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:44:02.811608+0000","last_clean_scrub_stamp":"2024-09-10T11:44:02.811608+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:16.408103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.125016+0000","last_change":"2024-09-10T11:44:04.125016+0000","last_active":"2024-09-10T11:44:04.125016+0000","last_peered":"2024-09-10T11:44:04.125016+0000","last_clean":"2024-09-10T11:44:04.125016+0000","last_became_active":"2024-09-10T11:38:36.640949+0000","last_became_peered":"2024-09-10T11:38:36.640949+0000","last_unstale":"2024-09-10T11:44:04.125016+0000","last_undegraded":"2024-09-10T11:44:04.125016+0000","last_fullsized":"2024-09-10T11:44:04.125016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.124926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.124926+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.124926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:49.215073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.758444+0000","last_change":"2024-09-10T11:44:05.758444+0000","last_active":"2024-09-10T11:44:05.758444+0000","last_peered":"2024-09-10T11:44:05.758444+0000","last_clean":"2024-09-10T11:44:05.758444+0000","last_became_active":"2024-09-10T11:38:36.639692+0000","last_became_peered":"2024-09-10T11:38:36.639692+0000","last_unstale":"2024-09-10T11:44:05.758444+0000","last_undegraded":"2024-09-10T11:44:05.758444+0000","last_fullsized":"2024-09-10T11:44:05.758444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.758347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.758347+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.758347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:03.762477+0000","last_change":"2024-09-10T11:44:03.762477+0000","last_active":"2024-09-10T11:44:03.762477+0000","last_peered":"2024-09-10T11:44:03.762477+0000","last_clean":"2024-09-10T11:44:03.762477+0000","last_became_active":"2024-09-10T11:38:35.639656+0000","last_became_peered":"2024-09-10T11:38:35.639656+0000","last_unstale":"2024-09-10T11:44:03.762477+0000","last_undegraded":"2024-09-10T11:44:03.762477+0000","last_fullsized":"2024-09-10T11:44:03.762477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:44:03.762409+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:44:03.762409+0000","last_clean_scrub_stamp":"2024-09-10T11:44:03.762409+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.062987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:04.788512+0000","last_change":"2024-09-10T11:44:04.788512+0000","last_active":"2024-09-10T11:44:04.788512+0000","last_peered":"2024-09-10T11:44:04.788512+0000","last_clean":"2024-09-10T11:44:04.788512+0000","last_became_active":"2024-09-10T11:38:36.643821+0000","last_became_peered":"2024-09-10T11:38:36.643821+0000","last_unstale":"2024-09-10T11:44:04.788512+0000","last_undegraded":"2024-09-10T11:44:04.788512+0000","last_fullsized":"2024-09-10T11:44:04.788512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:04.788439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:04.788439+0000","last_clean_scrub_stamp":"2024-09-10T11:44:04.788439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:12.658241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.769479+0000","last_change":"2024-09-10T11:44:05.769479+0000","last_active":"2024-09-10T11:44:05.769479+0000","last_peered":"2024-09-10T11:44:05.769479+0000","last_clean":"2024-09-10T11:44:05.769479+0000","last_became_active":"2024-09-10T11:38:35.639591+0000","last_became_peered":"2024-09-10T11:38:35.639591+0000","last_unstale":"2024-09-10T11:44:05.769479+0000","last_undegraded":"2024-09-10T11:44:05.769479+0000","last_fullsized":"2024-09-10T11:44:05.769479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-09-10T11:44:05.769400+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-09-10T11:44:05.769400+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.769400+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.831134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:00.864440+0000","last_change":"2024-09-10T11:44:00.864440+0000","last_active":"2024-09-10T11:44:00.864440+0000","last_peered":"2024-09-10T11:44:00.864440+0000","last_clean":"2024-09-10T11:44:00.864440+0000","last_became_active":"2024-09-10T11:38:36.640853+0000","last_became_peered":"2024-09-10T11:38:36.640853+0000","last_unstale":"2024-09-10T11:44:00.864440+0000","last_undegraded":"2024-09-10T11:44:00.864440+0000","last_fullsized":"2024-09-10T11:44:00.864440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:00.864322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:00.864322+0000","last_clean_scrub_stamp":"2024-09-10T11:44:00.864322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:49.793502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:57.691288+0000","last_change":"2024-09-10T11:43:57.691288+0000","last_active":"2024-09-10T11:43:57.691288+0000","last_peered":"2024-09-10T11:43:57.691288+0000","last_clean":"2024-09-10T11:43:57.691288+0000","last_became_active":"2024-09-10T11:38:35.640355+0000","last_became_peered":"2024-09-10T11:38:35.640355+0000","last_unstale":"2024-09-10T11:43:57.691288+0000","last_undegraded":"2024-09-10T11:43:57.691288+0000","last_fullsized":"2024-09-10T11:43:57.691288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-10T11:43:57.691153+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-10T11:43:57.691153+0000","last_clean_scrub_stamp":"2024-09-10T11:43:57.691153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:42.781299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:44:05.730380+0000","last_change":"2024-09-10T11:44:05.730380+0000","last_active":"2024-09-10T11:44:05.730380+0000","last_peered":"2024-09-10T11:44:05.730380+0000","last_clean":"2024-09-10T11:44:05.730380+0000","last_became_active":"2024-09-10T11:38:36.646386+0000","last_became_peered":"2024-09-10T11:38:36.646386+0000","last_unstale":"2024-09-10T11:44:05.730380+0000","last_undegraded":"2024-09-10T11:44:05.730380+0000","last_fullsized":"2024-09-10T11:44:05.730380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T11:44:05.730274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T11:44:05.730274+0000","last_clean_scrub_stamp":"2024-09-10T11:44:05.730274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:00.607855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T11:43:54.848082+0000","last_change":"2024-09-10T11:43:54.848082+0000","last_active":"2024-09-10T11:43:54.848082+0000","last_peered":"2024-09-10T11:43:54.848082+0000","last_clean":"2024-09-10T11:43:54.848082+0000","last_became_active":"2024-09-10T11:38:35.635885+0000","last_became_peered":"2024-09-10T11:38:35.635885+0000","last_unstale":"2024-09-10T11:43:54.848082+0000","last_undegraded":"2024-09-10T11:43:54.848082+0000","last_fullsized":"2024-09-10T11:43:54.848082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-09-10T11:43:54.847961+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-09-10T11:43:54.847961+0000","last_clean_scrub_stamp":"2024-09-10T11:43:54.847961+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:29.066391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":678737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":87877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":87913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":253952,"data_stored":89399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":87787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":249856,"data_stored":87947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":678793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T11:44:39.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T11:44:39.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 -- 172.21.15.57:0/4002992135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480706a0 msgr2=0x7f9f480d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/4002992135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480706a0 0x7f9f480d01b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9f38005fd0 tx=0x7f9f3802a560 comp rx=0 tx=0).stop 2024-09-10T11:44:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 -- 172.21.15.57:0/4002992135 shutdown_connections 2024-09-10T11:44:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/4002992135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480706a0 0x7f9f480d01b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 -- 172.21.15.57:0/4002992135 >> 172.21.15.57:0/4002992135 conn(0x7f9f480d1bf0 msgr2=0x7f9f480d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 -- 172.21.15.57:0/4002992135 shutdown_connections 2024-09-10T11:44:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.532+0000 7f9f4e09d640 1 -- 172.21.15.57:0/4002992135 wait complete. 2024-09-10T11:44:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.534+0000 7f9f4e09d640 1 Processor -- start 2024-09-10T11:44:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.534+0000 7f9f4e09d640 1 -- start start 2024-09-10T11:44:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f4e09d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f480706a0 0x7f9f480cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f4e09d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 0x7f9f4806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f4e09d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f480d06f0 0x7f9f480ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f4e09d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48071310 con 0x7f9f480721a0 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f4e09d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48071190 con 0x7f9f480d06f0 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f4e09d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9f48071490 con 0x7f9f480706a0 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 0x7f9f4806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f477fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f480706a0 0x7f9f480cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 0x7f9f4806edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34104/0 (socket says 172.21.15.57:34104) 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 -- 172.21.15.57:0/3043457814 learned_addr learned my addr 172.21.15.57:0/3043457814 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f47fff640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f480d06f0 0x7f9f480ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 -- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f480706a0 msgr2=0x7f9f480cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f480706a0 0x7f9f480cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 -- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f480d06f0 msgr2=0x7f9f480ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f480d06f0 0x7f9f480ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 -- 172.21.15.57:0/3043457814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4806f310 con 0x7f9f480721a0 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.536+0000 7f9f46ffd640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 0x7f9f4806edd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00c500 tx=0x7f9f3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.537+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0052d0 con 0x7f9f480721a0 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.537+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f3c005470 con 0x7f9f480721a0 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.537+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c012870 con 0x7f9f480721a0 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.537+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4806dd30 con 0x7f9f480721a0 2024-09-10T11:44:39.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.537+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4806e2f0 con 0x7f9f480721a0 2024-09-10T11:44:39.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.538+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f480d01b0 con 0x7f9f480721a0 2024-09-10T11:44:39.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.539+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 98028+0+0 (secure 0 0 0) 0x7f9f3c0035f0 con 0x7f9f480721a0 2024-09-10T11:44:39.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.539+0000 7f9f2ffff640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f340750a0 0x7f9f34077560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T11:44:39.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.539+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9f3c095e70 con 0x7f9f480721a0 2024-09-10T11:44:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.539+0000 7f9f477fe640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f340750a0 0x7f9f34077560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T11:44:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.540+0000 7f9f477fe640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f340750a0 0x7f9f34077560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9f38033000 tx=0x7f9f38004730 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T11:44:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.545+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178907 (secure 0 0 0) 0x7f9f3c05fa70 con 0x7f9f480721a0 2024-09-10T11:44:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.808+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9f480b45f0 con 0x7f9f480721a0 2024-09-10T11:44:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.816+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f9f3c064230 con 0x7f9f480721a0 2024-09-10T11:44:39.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.817+0000 7f9f2ffff640 1 -- 172.21.15.57:0/3043457814 <== mon.0 v2:172.21.15.57:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f9f3c05f580 con 0x7f9f480721a0 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f340750a0 msgr2=0x7f9f34077560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f340750a0 0x7f9f34077560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9f38033000 tx=0x7f9f38004730 comp rx=0 tx=0).stop 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 msgr2=0x7f9f4806edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 0x7f9f4806edd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00c500 tx=0x7f9f3c00c9c0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 shutdown_connections 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:6816/2487136894,v1:172.21.15.154:6817/2487136894] conn(0x7f9f340750a0 0x7f9f34077560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f480d06f0 0x7f9f480ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f480721a0 0x7f9f4806edd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 --2- 172.21.15.57:0/3043457814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f480706a0 0x7f9f480cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.819+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 >> 172.21.15.57:0/3043457814 conn(0x7f9f480d1bf0 msgr2=0x7f9f480c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.820+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 shutdown_connections 2024-09-10T11:44:39.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-09-10T11:44:39.820+0000 7f9f4e09d640 1 -- 172.21.15.57:0/3043457814 wait complete. 2024-09-10T11:44:39.832 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1978, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-10T11:44:39.834 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T11:44:39.834 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T11:44:39.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:39.846 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T11:44:39.846 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T11:44:39.846 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:39.898 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T11:44:39.898 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T11:44:39.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:39.909 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T11:44:39.909 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T11:44:39.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:39.960 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T11:44:39.961 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T11:44:39.961 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T11:44:39.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:39.996 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T11:44:39.996 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T11:44:39.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.061 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T11:44:40.061 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T11:44:40.061 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.126 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T11:44:40.126 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T11:44:40.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.194 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T11:44:40.195 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T11:44:40.195 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.216 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T11:44:40.216 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T11:44:40.216 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.283 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T11:44:40.283 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T11:44:40.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.352 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T11:44:40.352 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T11:44:40.352 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.431 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T11:44:40.432 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T11:44:40.432 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T11:44:40.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.458 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T11:44:40.458 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T11:44:40.458 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.500 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T11:44:40.500 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T11:44:40.500 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T11:44:40.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.512 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T11:44:40.512 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T11:44:40.512 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.552 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T11:44:40.552 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T11:44:40.552 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T11:44:40.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-10T11:44:40.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-10T11:44:40.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-10T11:44:40.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-10T11:44:40.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-10T11:44:40.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-10T11:44:40.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-10T11:44:40.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-10T11:44:40.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-10T11:44:40.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-10T11:44:40.604 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T11:44:40.604 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T11:44:40.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T11:44:40.719 INFO:teuthology.orchestra.run.smithi057.stdout:2024-09-10T11:38:16.472076+0000 mgr.y (mgr.4150) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-10T11:44:40.720 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T11:44:40.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T11:44:40.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-10T11:44:40.841 INFO:teuthology.orchestra.run.smithi057.stdout:2024-09-10T11:38:16.472076+0000 mgr.y (mgr.4150) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-10T11:44:40.841 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:44:40.842 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T11:44:45.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-10T11:44:45.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-10T11:44:45.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-10T11:44:45.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-10T11:44:45.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-10T11:44:45.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-10T11:44:45.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-10T11:44:45.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-10T11:44:45.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-10T11:44:45.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-10T11:44:49.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:44:49.886 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T11:44:50.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:44:50.000 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T11:44:50.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:44:50.080 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T11:44:50.192 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:44:50.193 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T11:44:52.311 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:44:52.311 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T11:44:52.408 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:44:52.408 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T11:44:52.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:44:52.492 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T11:44:52.552 INFO:tasks.ceph:Archiving mon data... 2024-09-10T11:44:52.553 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/data/mon.a.tgz 2024-09-10T11:44:52.553 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-09-10T11:44:52.569 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.2XGrjwvZvr 2024-09-10T11:44:52.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2XGrjwvZvr 2024-09-10T11:44:52.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.2XGrjwvZvr 2024-09-10T11:44:52.794 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.2XGrjwvZvr is 303KB 2024-09-10T11:44:52.888 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.2XGrjwvZvr 2024-09-10T11:44:52.904 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/data/mon.b.tgz 2024-09-10T11:44:52.904 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-10T11:44:52.919 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.wKi9OvU8wT 2024-09-10T11:44:52.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wKi9OvU8wT 2024-09-10T11:44:53.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.wKi9OvU8wT 2024-09-10T11:44:53.162 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.wKi9OvU8wT is 414KB 2024-09-10T11:44:53.257 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.wKi9OvU8wT 2024-09-10T11:44:53.273 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/data/mon.c.tgz 2024-09-10T11:44:53.273 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-10T11:44:53.327 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.tPP3eV4mYV 2024-09-10T11:44:53.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tPP3eV4mYV 2024-09-10T11:44:53.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.tPP3eV4mYV 2024-09-10T11:44:53.555 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.tPP3eV4mYV is 414KB 2024-09-10T11:44:53.650 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.tPP3eV4mYV 2024-09-10T11:44:53.665 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T11:44:53.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T11:44:53.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T11:44:53.747 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T11:44:53.785 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T11:44:53.786 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T11:44:53.787 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/remote/smithi057/crash 2024-09-10T11:44:53.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T11:44:53.815 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/remote/smithi154/crash 2024-09-10T11:44:53.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T11:44:53.852 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T11:46:12.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T11:46:12.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T11:46:12.262 INFO:tasks.ceph:Compressing logs... 2024-09-10T11:46:12.262 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:46:12.265 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T11:46:12.293 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T11:46:12.293 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47915.log 2024-09-10T11:46:12.294 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36516.log 2024-09-10T11:46:12.294 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47915.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30279.log 2024-09-10T11:46:12.294 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36516.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47915.log.gz 2024-09-10T11:46:12.294 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2024-09-10T11:46:12.294 INFO:teuthology.orchestra.run.smithi057.stderr: 75.8% -- replaced with /var/log/ceph/ceph-client.admin.36516.log.gz 2024-09-10T11:46:12.295 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.30279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-09-10T11:46:12.295 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30279.log.gz 2024-09-10T11:46:12.315 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46338.log 2024-09-10T11:46:12.315 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47452.log: /var/log/ceph/ceph-client.admin.46338.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46695.log 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46338.log.gz 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47579.log 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46695.log.gz 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47579.log.gz 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2024-09-10T11:46:12.316 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr: 75.0% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45630.log 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44795.log 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45630.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2024-09-10T11:46:12.317 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45630.log.gz 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44795.log.gz 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gz 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46110.log 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46110.log.gz 2024-09-10T11:46:12.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43055.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36743.log 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36743.log.gz 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2024-09-10T11:46:12.319 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43949.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47999.log 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48756.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gz 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43433.log 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47999.log: /var/log/ceph/ceph-client.admin.48336.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.47999.log.gz 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47831.log 2024-09-10T11:46:12.320 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36404.log 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43433.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49071.log 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47831.log: /var/log/ceph/ceph-client.admin.36404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42386.log 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.36404.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47831.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.49071.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42386.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49071.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36776.log 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2024-09-10T11:46:12.321 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36776.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36776.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45984.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47494.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49323.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45984.log: /var/log/ceph/ceph-client.admin.49323.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45984.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45233.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49323.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48966.log 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2024-09-10T11:46:12.322 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46068.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45233.log: /var/log/ceph/ceph-client.admin.48966.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45233.log.gzgzip 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45942.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48966.log.gz 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42482.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45942.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46068.log.gz 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45942.log.gz 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45546.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42482.log.gz 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-09-10T11:46:12.323 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.45546.log.gz -- 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.47199.log 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44837.log: /var/log/ceph/ceph-client.admin.48924.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46422.log 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47199.log: /var/log/ceph/ceph-client.admin.45317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43608.log 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46422.log.gz 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36368.log 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-09-10T11:46:12.324 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36722.log 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43608.log: /var/log/ceph/ceph-client.admin.36368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43608.log.gz 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36368.log.gz 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36722.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36722.log.gz 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2024-09-10T11:46:12.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2024-09-10T11:46:12.354 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-09-10T11:46:12.354 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T11:46:12.354 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36497.log 2024-09-10T11:46:12.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36377.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T11:46:12.354 INFO:teuthology.orchestra.run.smithi154.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36497.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.b.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36497.log.gz 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36417.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36297.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36417.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36417.log.gz 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36297.log.gz 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36457.log 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T11:46:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36206.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36457.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36457.log.gz 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36246.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36337.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-09-10T11:46:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36246.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36246.log.gz 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46590.log 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48714.log: /var/log/ceph/ceph-client.admin.49239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45672.log 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2024-09-10T11:46:12.396 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46590.log.gz 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45672.log: /var/log/ceph/ceph-client.admin.44567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45672.log.gz 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47621.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gzgzip 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46863.log: /var/log/ceph/ceph-client.admin.47621.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42968.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47621.log.gz 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36896.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43951.log: /var/log/ceph/ceph-client.admin.42968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2024-09-10T11:46:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42968.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47747.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36896.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48546.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47747.log: /var/log/ceph/ceph-client.admin.48546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47747.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48546.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45486.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48083.log: /var/log/ceph/ceph-client.admin.47115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49281.log 2024-09-10T11:46:12.398 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48041.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45486.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49281.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48041.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44963.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45149.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44284.log: /var/log/ceph/ceph-client.admin.45149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42648.log 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45149.log.gz 2024-09-10T11:46:12.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36488.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42648.log.gz 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36488.log.gz 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48672.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44483.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44276.log: /var/log/ceph/ceph-mds.a.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2024-09-10T11:46:12.400 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44483.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.45443.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43265.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46296.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47789.log: 86.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46296.log.gz 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2024-09-10T11:46:12.401 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46236.log: /var/log/ceph/ceph-client.admin.48125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43307.log 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45191.log 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36861.log 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43307.log: /var/log/ceph/ceph-client.admin.45191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43307.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45191.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46989.log 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36861.log.gz 2024-09-10T11:46:12.402 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46506.log 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48630.log: /var/log/ceph/ceph-client.admin.46989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46989.log.gz 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46506.log.gz 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43948.log: /var/log/ceph/ceph-client.admin.42787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44651.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T11:46:12.403 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48504.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43614.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48504.log: /var/log/ceph/ceph-client.admin.49155.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48504.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42829.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42829.log.gz 2024-09-10T11:46:12.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36760.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48882.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48798.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36760.log.gz 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48882.log.gz 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48798.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48798.log.gz 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45588.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46152.log 2024-09-10T11:46:12.405 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45588.log.gz 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47705.log 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46152.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46152.log.gz 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46380.log 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47705.log.gz 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46464.log 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46380.log.gz/var/log/ceph/ceph-client.admin.46464.log: 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46464.log.gz 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph.log 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48210.log 86.7% 2024-09-10T11:46:12.406 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48210.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43349.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42692.log 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49197.log 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42692.log: gzip -5 --verbose 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42692.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.43181.log 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49197.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49197.log.gz 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.42564.log 2024-09-10T11:46:12.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43181.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.44281.log 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46632.log 86.9% 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44281.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46947.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46632.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36844.log 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36844.log: gzip -5 --verbose -- 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36844.log.gz 2024-09-10T11:46:12.408 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.46548.log 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46548.log.gz 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46905.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.48420.log 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46026.log 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48420.log.gz 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44753.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46026.log.gz 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36460.log 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44753.log.gz 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43012.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.47241.log 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36460.log.gz 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45089.log 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-09-10T11:46:12.410 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45089.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47536.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48840.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36432.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47536.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48168.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48840.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36432.log: /var/log/ceph/ceph-client.admin.48168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36432.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48168.log.gz 2024-09-10T11:46:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43391.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45401.log: /var/log/ceph/ceph-client.admin.43950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37094.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43097.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43391.log.gz 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48252.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.37094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36671.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37094.log.gz 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48252.log.gz 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45900.log 2024-09-10T11:46:12.412 INFO:teuthology.orchestra.run.smithi057.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36671.log.gz 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36311.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46194.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45714.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45900.log.gz 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46194.log.gz 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45275.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz/var/log/ceph/ceph-client.admin.44147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45840.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45275.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45275.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45840.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45840.log.gz/var/log/ceph/ceph-client.admin.44278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43615.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37295.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47663.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36613.log: 75.3% -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.37295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37295.log.gz 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37385.log 2024-09-10T11:46:12.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42736.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47663.log.gz 2024-09-10T11:46:12.415 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2024-09-10T11:46:12.415 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.37385.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37385.log.gz 2024-09-10T11:46:12.415 INFO:teuthology.orchestra.run.smithi057.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T11:46:12.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T11:46:12.449 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T11:46:12.453 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T11:46:12.455 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T11:46:12.461 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T11:46:12.544 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T11:46:12.551 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T11:46:12.551 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T11:46:12.568 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T11:46:12.636 INFO:teuthology.orchestra.run.smithi057.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T11:46:29.594 INFO:teuthology.orchestra.run.smithi154.stderr: 96.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T11:46:29.595 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-10T11:46:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m17.273s 2024-09-10T11:46:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m17.524s 2024-09-10T11:46:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.710s 2024-09-10T11:46:37.686 INFO:teuthology.orchestra.run.smithi057.stderr: 96.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T11:46:37.688 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-09-10T11:46:37.688 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m25.408s 2024-09-10T11:46:37.688 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m25.283s 2024-09-10T11:46:37.688 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m1.078s 2024-09-10T11:46:37.688 INFO:tasks.ceph:Archiving logs... 2024-09-10T11:46:37.689 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/remote/smithi057/log 2024-09-10T11:46:38.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:46:52.791 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/remote/smithi154/log 2024-09-10T11:46:52.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T11:47:04.184 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1978, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-10T11:47:04.402 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d572529f7c45474e80efb690724febf1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1978, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-10T11:47:04.404 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T11:47:04.412 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T11:47:04.421 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T11:47:04.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:47:04.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T11:47:04.510 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T11:47:04.520 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T11:47:04.520 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:47:04.524 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T11:47:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:47:04.541 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T11:47:04.543 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:47:04.543 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-09-10T11:47:04.544 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -95us[ -162us] +/- 40ms 2024-09-10T11:47:04.544 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -104us[ -104us] +/- 51ms 2024-09-10T11:47:04.544 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +266us[ +266us] +/- 69ms 2024-09-10T11:47:04.544 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:47:04.545 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T11:47:04.546 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T11:47:04.546 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -85us[ -142us] +/- 40ms 2024-09-10T11:47:04.546 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -102us[ -159us] +/- 51ms 2024-09-10T11:47:04.546 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +278us[ +222us] +/- 69ms 2024-09-10T11:47:04.546 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T11:47:04.547 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T11:47:04.555 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T11:47:04.555 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T11:47:04.563 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:47:04.660 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T11:47:04.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T11:47:04.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:47:04.762 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T11:47:04.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:47:04.792 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T11:47:04.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T11:47:04.810 INFO:teuthology.task.internal:Duration was 916.873388 seconds 2024-09-10T11:47:04.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T11:47:04.818 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T11:47:04.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:47:04.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T11:47:04.864 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:47:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T11:47:05.290 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T11:47:05.290 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-09-10T11:47:05.291 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:47:05.355 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T11:47:05.356 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T11:47:05.389 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T11:47:05.389 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:47:05.399 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T11:47:05.457 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T11:47:05.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:47:05.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T11:47:05.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T11:47:05.608 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T11:47:05.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:47:05.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T11:47:05.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T11:47:05.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:47:05.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:47:05.699 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-09-10T11:47:05.723 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-10T11:47:05.747 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:47:05.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:47:05.781 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T11:47:05.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T11:47:05.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T11:47:05.812 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T11:47:05.812 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/remote/smithi057 2024-09-10T11:47:05.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:47:05.857 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-09-10_07:26:29-fs:volumes-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7899097/remote/smithi154 2024-09-10T11:47:05.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T11:47:05.890 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T11:47:05.890 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:47:05.894 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T11:47:05.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T11:47:05.951 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T11:47:05.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T11:47:05.961 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T11:47:05.961 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:47:05.964 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T11:47:05.977 INFO:teuthology.orchestra.run.smithi057.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:47 /home/ubuntu/cephtest 2024-09-10T11:47:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 11:47 /home/ubuntu/cephtest 2024-09-10T11:47:05.997 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T11:47:06.007 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T11:47:06.033 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 916.8733880519867 failure_reason: '"2024-09-10T11:38:16.472076+0000 mgr.y (mgr.4150) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log' flavor: default owner: scheduled_khiremat@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d572529f7c45474e80efb690724febf1 status: fail success: false 2024-09-10T11:47:06.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T11:47:06.101 INFO:teuthology.run:FAIL